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IN THE UNITED STATES ELECTED OFFICE 
OF THE UNITED STATES PATENT AND TRADEMARK OFFICE 
UNDER THE PATENT COOPERATION TREATY-CHAPTER H 

" PRELIMINARY AMENDMENT " 

5 APPLICANT: Thomas RIEGEL 

SERIAL NO. : EXAMINER: 

FILING DATE: ART UNIT: 

INTERNATIONAL APPLICATION NO. : PCT/DE99/03 1 9 1 

INTERNATIONAL FILING DATE: 4 October 1999 

1 0 INVENTION: METHOD AND DEVICE FOR PROCESSINGIGITIZED 

IMAGE 

Hon. Assistant Commissioner for Patents 
Box PCT 
Washington D.C. 20231 

15 SIR: 

Amend the above-identified international application before entry into the 
national stage before the U.S. Patent & Trademark Office under 35 U.S.C. §371 
as follows: 

IN THE SPECIFICATION 

2 0 The specification has been amended as follows: 

SPECIFICATION 
TITLE 

METHOD AND ARRANGEMENT FOR PROCESSING A DIGITALIZED 



-2- 



IMAGE 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention is directed to an arrangement and to a method for 
5 processing a digitahzed image as utiHzed and implemented in the framework of 
an encoding and decoding of a digitahzed image. 

Such a method and such an arrangement are utihzed in the framework of 
an encoding and decoding of a digitahzed image corresponding to one of the 
image encoding standards H.261 the pubUcation by D. Le Gall, "The Video 
1 0 Compression Standard for Multimedia Applications", Communications of ACM, 
H.263 the pubhcation by G. Wallace, "The JPEG Still Picture Compression 
Standard", Communications of ACM of MPEG2 the pubhcation by De 
Lameillieure, J. et al., "MPEG-2-Bildcodierung far das digitale Femsehen" in 
FERNSEH- UND KINO-TECHNIK that are based on the principle of a block- 
15 based image encoding. According to the publication by De Lameillieure, J, et al., 
"MPBG-2-Bildcodiemng ftir das digitale Femsehen" in FERNSEH- UND KINO- 
TECHNIK, the method of a block-based discrete cosine transformation (DCT) is 
employed for block-based image encoding. 

Another approach for processing a digitahzed image corresponding to the 
2 0 image encoding standard MPEG4 is what is referred to as the principle of object- 
based image encoding, as known from the publication by De Lameilheure, J. et 
al., "MPEG-2-Bildcodierung fiir das digitale Femsehen" in FERNSEH- UND 
KINO-TECHNIK. 

In object-based image encoding, a segmentation of an image master into 
2 5 image blocks ensues corresponding to objects occmring in a scene, and a separate 
encoding of these objects ensues. 

Components of a standard arrangement for an image encoding, as also 
known from the pubhcation by W. Niem, et al., "Mapping texture from multiple 
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Camera Views onto 3D Object Models for Computer Animation", Proc. of 
International Workshop on Stereoscopic and Three Dimensional Imaging, and of 
an image decoding can be derived from Figure 7. 

Figure 7 shows a camera 701 with which images are registered. The 
5 camera 701 can, for example, be an arbitrary analog camera 701 that registers 
images of a scene and either digitalizes the images in the camera 701 and 
transmits the digitalized images to a first computer 702 that is coupled to the 
camera 701 or transmits the images to the first computer 702 in analog form as 
well. In the fu*st computer 702, the analog images are converted into digitalized 
1 0 images and the digitalized images are processed. 

The camera 701 can also be a digital camera 701 with which directly 
digitalized images are registered and supplied to the first computer 702 for further 
processing. 

The first computer 702 can also be designed as an autonomous 
1 5 arrangement with which the method steps described below are implemented, for 
example as an autonomous computer card that is installed in a fiirther computer. 
What is to be generally understood by the first computer 702 is a unit that 
can implement an image signal processing according to the method described 
below, for example a mobile terminal device (mobile telephone with a picture 
2 0 screen). 

The first computer 702 comprises a processor unit 704 with which the 
method steps of the image encoding and image decoding described below are 
implemented. The processor unit 704, for example, is coupled via a bus 705 to a 
memory 706 in which an image information is stored. 
2 5 In general, the methods described below can be realized both in software 

as well as in hardware or partly in software and partly in hardware. 

After the image encoding has ensued in the first computer 701 and afl;er 
the transmission of the encoded image information via a transmission medium 
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707 to a second computer 708, the image decoding is implemented in the second 
computer 708. 

The second computer 708 can have the same structure as the first 
computer 701. The second computer 708 thus also comprises a processor 709 that 
5 is coupled to a memory 710 by a bus 711 . 

Figure 8 shows a possible arrangement in the form of a schematic diagram 
of the image encoding or, respectively, image decoding. The illustrated 
arrangement can be employed within the framework of a block-based image 
encoding and - also shall be explained in greater detail later — can be employed 
10 in part within the framework of an object-based image encoding. 

hi the block-based image encoding, a digitaUzed image 801 is divided into 
what are usually quadratic image blocks 826 having a size of 8x8 picture elements 
802 or 16x16 picture elements 802 and is supphed to the arrangement 803 for 
image encoding. 

1 5 Coding information, for example brightness information (luminance 

values) and/or color information (chrominance values), is usually allocated to a 
picture element 802, 

In block-based image encoding, a distinction is made between different 
image encoding modes. 
2 0 In what is referred to as intra-image encoding, the digitalized image 801 is 

respectively encoded with the coding information allocated to the picture elements 
802 of the digitalized image and is transmitted. 

hi what is referred to as an inter-image encoding, only a difference image 
information of two chronologically successive, digitalized images 801 is 
2 5 respectively encoded and transmitted. 

The difference information is very small when movements of image 
objects are slight in the chronologically successive, digitalized images 801. When 
the movements are great, then a great deal of difference information arises that is 
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difficult to encode. For this reason and as known from the publication by De 
LameiUieure, J. et al,, "MPEG-2-Bildcodienmg fur das digitale Femsehen" in 
FERNSEH- UND KINO-TECHNIK, an "image-to-image" movement (motion 
estimate) is measured and compensated before the determination of the difference 
5 information (motion compensation). 

There are different methods for the motion estimation and the motion 
compensation as known from the pubhcation by De LameiUieure, J. et ah, 
"MPEG-2-Bildcodierung fur das digitale Femsehen" in FERNSEH- UND KINO- 
TECHNIK. What is referred to as a "block matching method" is usually utilized 

1 0 for the block-based image encoding. It is based thereon that an image block to be 
encoded is compared to reference image blocks of the same size in a reference 
image. The sum of the absolute differences of an encoding information that is 
respectively allocated to a picture element is usually employed as a criterion for a 
coincidence quality between the block to be encoded and a respective reference 

1 5 image block. In this way, a motion information for the image block is 

determined, for example a motion vector, this being transmitted with the 
difference information. 

Two switch imits 804 are provided for switching between the intra-image 
encoding and the inter-image encoding. A subtraction unit 805 wherein the 

2 0 difference of the image information of two chronologically successive, digitahzed 
images 801 is formed is provided for the implementation of the inter-image 
encoding. The image encoding is controlled via an image encoding control unit 
806, The image blocks 823 to be encoded or, respectively, difference image 
blocks are respectively supphed to a transformation encoding unit 807. The 

25 transformation encoding unit 807 applies a transformation encoding, for example 
a discrete cosine transformation (DCT), to the encoding information allocated to 
the picture elements 802, 

In general, however, any desired transformation encoding, for example a 
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discrete sine transformation or a discrete Fourier transformation, can be applied 
for the image encoding. 

Spectral coefficients (transformation coefficients) are formed by the 
transformation encoding. The spectral coefficients are quantized in a quantization 
5 unit 808 and are supplied to an image encoding multiplexer 821, for example to a 
channel encoding and/or to an entropy encoding. The quantized spectral 
coefficients are inversely quantized in an inverse quantization imit 809 and are 
subjected to an inverse transformation encoding in an inverse transformation 
encoding unit 810. 

10 hi the case of inter-image encoding, further, image information of the 

respective, chronologically preceding image are added in an adder unit 811. The 
images reconstructed in this way are stored in a memory 812. For simpler 
presentation, a unit relating to the motion compensation 813 is symbohcally 
presented in the memory 812. 

1 5 Further, a loop filter 8 1 4 is provided that is connected to the memory 8 1 2 

as well as to the subtraction unit 805. 

Li addition to a transmitted image information 822, a mode index that 
respectively indicates whether an intra-image encoding or inter-image encoding 
was undertaken is also supphed to the image encoding multiplexer 821, 

2 0 Further, quantization indices 816 for the spectral coefficients are supphed 

to the image encoding multiplexer 821. 

A motion vector is respectively allocated to an image block 820 and/or to 
a macro block 823 that, for example, comprises four image blocks 820 and is 
supplied to the image encoding multiplexer 821. 

2 5 Further, an information particular for the activation or, respectively, 

deactivation of the loop filter is provided. After transmission of the image 
information via a transmission medium 818, the decoding of the transmitted 
information can ensue in a second computer 819. To this end, an image decoding 
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imit 825 is provided in the second computer 819, this unit 825, for example, 
comprising the structure of a reconstruction loop of the arrangement shown in 
Figure 8. 

The publication by T. Sikora et al., "Shape Adaptive DCT for Generic 
5 Coding of Video", EEEE Transactions on Circuits and Systems for Video 

Technology discloses a shape-adapted transformation encoding is specifically 
applied in the framework of an object-based image encoding to edge image block 
or image blocks that contain only partially relevant encoding information. The 
edge image blocks encoded upon employment of a shape-adapted transformation 

1 0 encoding are characterized in that only the picture elements that are allocated to 
an object or, respectively, that comprise encoding information relevant to the 
object are encoded. 

The method described in the publication by T. Sikora et al., "Shape 
Adaptive DCT for Generic Coding of Video", IEEE Transactions on Circuits and 

1 5 Systems for Video Technology is what is referred to as a shape-adapted Discrete 
Cosine Transformation (Shape- Adaptive DCT, SA-DCT). 

Within the framework of an SA-DCT, the transformation coefficients 
allocated to an image object are defined such that picture elements of an edge 
image block that do not belong to the image object are blanked out. A one- 

2 0 dimensional DCT is then initially applied to the remaining picture elements 

colimm-by-column, the length thereof corresponding to the number of remaining 
picture elements in the respective colunan. The resulting transformation 
coefficients are horizontally aligned and are subsequently subject to a finther one- 
dimensional DCT in a horizontal direction with a corresponding length. 

2 5 The rule of SA-DCT known from the publication by T. Sikora et aL, 

"Shape Adaptive DCT for Generic Coding of Video", IEEE Transactions on 
Circuits and Systems for Video Technology proceeds from a transformation 
matrix DCT-N having the following structure: 
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DCT- N(p,k) = ^ *cos 



'n 



(1) 



withp, k = 0-N-l. 

N references a quantity of the image vector to be transformed wherein the 
transformed picture elements are contained, 

DCT-N references a transformation matrix having the size NxN. 

p, k reference indices with p, k e [0, N-1]. 

After the SA-DCT, each colxmm of the image block to be transformed is 
vertically transformed according to the rule 



(2) 



1 0 Subsequently, the same rule is applied to the resultant data in a horizontal 
direction. 

Various methods for the presentation of an object on a picture screen are 
employed in computer graphics. One method for the presentation of a subject is 
what is referred to as texture mapping. 
1 5 The publication by J.D. Foley et al, "Computer graphics: principles and 

practise" discloses such a texture mapping. 

In the framework of texture mapping, a digital image that contains a 
brightness information (luminance values) and/or a color information 
(chrominance values) of the object to be presented is mapped onto a surface of a 
2 0 three-dimensional model of an object to be presented. 

The three-dimensional model 301 of the object to be presented, the model 
301 being shown in Figure 3A, is composed of a spatial, triangular grid structure 
301, whereby the comer points 302 of the triangles 303 are present as points 304 
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of a Cartesian coordinate system 305. 

As shown in Figure 3B, what is referred to as a block-shaped structure 
map 306 is allocated to each triangle 303, as shown in Figure 3B, the map 306 
being constructed of picture elements 307 that are arranged rectangularly or, 
5 respectively, block-like. A brightness information (luminance values) and/or a 
color information (chrominance values) is usually allocated to each picture 
element 307. 

The brightness or color information is allocated to the triangle 303 such 
that an appertaining picture element 307 of the appertaining structure map 306 is 
1 0 respectively allocated to a comer point 302 and 308 of the triangle 303 and 309. 

The position of a comer point 308 of the triangle 309 is defined by the 
indication of coordinates (u^, v^) 310 in a two-dimensional coordinate system (u, 
v) 3 1 1 that is assigned to the stmcture map 306. The coordinates (Ui, vj 3 10 are 
usually normed. 

1 5 Via a transformation mle (allocation or, respectively, allocation key), the 

corresponding point 3 10 in the appertaining structure map 306 is allocated to each 
comer point 302 of each triangle 303 of the three-dimensional model 301. 

As shown in Figure 4, further, all stmcture maps 401 are combined into a 
digitalized image 402, what is referred to as a superstmcture map 402, wherein 

2 0 the individual stmcture maps 401 are arranged row-by-row and colunm-by- 
column. As warranted, the stmcture maps 401, which contain encoding 
information relevant for the presentation of the object, must be supplemented with 
stmcture maps 404 that contain no encoding information that is relevant for the 
presentation of the subject. 

25 In particular, however, the above-described method exhibits a 

disadvmtage. The stmcture maps and the superstmcture maps as well comprise 
picture elements that contain no brightness or color information relevant for the 
representation of the object. 
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When the superstructure map is encoded in the framework of an image 
transmission, then the data rate occurring in the transmission is unnecessarily 
increased by the non-relevant picture elements. 

For improving the above method, a structure map is processed in the 
5 following way (see Figure 5): 

Those picture elements 501 of a structure map 502 that contain picture 
elements of an encoding information relevant for the presentation of the object are 
transformed into a new triangular structure map 503 with picture elements 506 
that are arranged in a predetermined shape - usually a right triangle - and in a 
1 0 predetermined size. The transformation is implemented such that the picture 

elements 501, which are comer picture elements 504 of the triangle 505, coincide 
with picture elements 506 that are comer picture elements 507 of the triangular 
stmcture map. 

In the scope of the transformation, picture elements may potentially have 
15 to be generated by an extrapolation or an interpolation of values that contain a 
brightness or color information or picture elements may potentially have to be 
deleted. 

The triangular structure map 503 thus only comprises picture elements 506 
that are relevant for the presentation of an object. 
2 0 As shown in Figure 6, all triangular stmcture maps 601 that contain 

brightness or color information relevant for the presentation of the object are 
arranged to form a new superstmcture map 602, 

To that end, respectively two triangular stmcture maps 601a and 601b are 
arranged to form a block-shaped stmcture map 603. 
2 5 Further, all block-shaped stmcture maps 603 are grouped by rows and 

colunms, a digitalized image being thus generated. 

The pubUcation by J.D. Foley et al., "Computer graphics: principles md 
practise" also discloses that such a superstmcture map as generated in the 
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framework of a texture mapping is encoded and decoded in an image 
transmission. 

The encoding and/or decoding of a superstructure map thereby usually 
ensues upon employment of a block-oriented transformation in the intra-image 
5 encoding mode, as was set forth above. 

As implemented in the framework of a processing of a digital image, this 
procedure is not very efficient in view of a low data rate to be desired for a 
transmission or in view of a higher image quality. 

SUMMARY OF THE INVENTION 

1 0 The invention is thus based on the problem of specifying a method for 

processing a digitalized image and an arrangement for processing a digitalized 
image with which a more efficient processing of a digitalized image becomes 
possible. 

The problems of the prior art are addressed by a method for processing a 
15 digitalized image with picture elements that contain an encoding information, 

a) whereby the image is at least partially divided into image blocks; 

b) whereby an appertaining image block is respectively subdivided into at 
least two appertaining image sub-blocks; 

wherein the processing of the image is implemented such that a first value, a 
2 0 second value and a third value are respectively allocated to at least one image sub- 
block, whereby the first value and the second value describe the relative position 
of the appertaining image block with respect to the image and the third value 
describes the relative position of the appertaining image sub-block with respect to 
the appertaining image block. The problems of the prior art are also addressed by 
2 5 an arrangement for processing a digitalized image with picture elements that 
contain an encoding information, whereby a processor is provided that is 
configured such that the following method steps can be implemented: 
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a) the image is at least partially divided into image blocks; 

b) an appertaining image block is respectively subdivided into at least two 
appertaining image sub-blocks; 

wherein the processing of the image is implemented such that a first value, a 
5 second value and a third value are respectively allocated to at least one image sub- 
block, whereby the first value and the second value describe the relative position 
of the appertaining image block with respect to the image and the third value 
describes the relative position of the appertaining image sub-block with respect to 
the appertaining image block. 

10 In the method for processing a digitalized image with picture elements that 

contain an encoding information, the image is at least partly divided into image 
blocks. Respectively one image block is subdivided into at least two appertaining 
image sub-blocks. The processing of the image is implemented such that a first 
value, a second value and a third value are respectively allocated to at least one 

1 5 appertaining image sub-block, whereby the first value and the second value 

describe the relative position of the appertaining image block with respect to the 
image and the third value describes the relative position of the appertaining image 
sub-block with respect to the appertaining image block. 

In the arrangement for processing a digitalized image having picture 

2 0 elements that contain an encoding information, a processor is provided that is 
configured such that the following method steps can be implemented: 
The image is at least partially divided into image blocks. Respectively one image 
block is subdivided into at least two appertaining image sub-blocks. The 
processing of the image is implemented such that a first value, a second value and 

2 5 a third value are respectively allocated to at least one of the appertaining image 
sub-blocks, whereby the first value and the second value describe the relative 
position of the appertaining image block with respect to the image and the third 
value describes the relative position of the appertaining image sub-block with 
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respect to the appertaining image block. 

In the method, the appertaining image block may be subdivided into a 
plurality of appertaining image sub-blocks. The first value, the second value and 
the third value are respectively allocated to each appertaining image sub-block. 
5 The image blocks may be arranged in columns and rows and/or column numbers 
may be assigned to the columns and row numbers are assigned to the rows. The 
first value of the appertaining image sub-block is the row number of the 
appertaining image block and the second value of the appertaining image sub- 
block is the column number of the appertaining image block. The appertaining 

1 0 image sub-blocks may exhibit a different shape than the appertaining image block. 
The image sub-blocks can comprise a triangular shape. Preferably, the triangular 
shape comprises a right angle. In the method, the appertaining image sub-blocks 
are modified such that the respective position of an appertaining image sub-block 
with respect to the appertaining image block is respectively identical. In a 

15 preferred embodiment, the method is utilized in the framework of an encoding of 
the image. The image sub-blocks are encoded upon employment of the encoding 
information and/or upon employment of the first value, the second value and the 
third value with a shape-adaptive transformation encoding. In one embodiment, a 
shape-adaptive Discrete Cosine Transformation (DCT) is utilized for the 

2 0 encoding. Specifically, a Shape- Adaptive Discrete Cosine Transformation (SA- 
DCT) is utihzed for the encoding. Further, a Triangle- Adaptive Discrete Cosine 
Transformation (TA-DCT) is utilized for the encoding. The method may be 
utilized in the framework of a decoding of the image. In particular, an inverse 
shape-adaptive Discrete Cosine Transformation (DCT) is utilized for the 

2 5 decoding. Further, an inverse Shape- Adaptive Discrete Cosine Transformation 
(SA-DCT) is utilized for the decoding. In particular, an inverse Triangle- 
Adaptive Discrete Cosine Transformation (TA-DCT) is utilized for the decoding. 
In the method, the image at least partly comprises triangular structure maps. 
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The foregoing method of a preferred embodiment provides that the 
appertaining image block can be subdivided into a pluraUty of appertaining image 
sub-blocks. The respective first value and the respective second value and the 
respective third value can be allocated to each appertaining image sub-block. The 
5 arrangement can be utihzed in the framework of an encoding of the image. A 
shape-adaptive Discrete Cosine Transformation (DCT) can be utilized for the 
encoding. For example, an inverse Triangle- Adaptive Discrete Cosine 
Transformation (TA-DCT) can be utilized for the encoding. The arrangement can 
be utilized in the framework of a decoding of the image. An inverse shape- 

1 0 adaptive Discrete Cosine Transformation (DCT) can be utilized for the decoding. 

The inverse Triangle- Adaptive Discrete Cosine Transformation (TA-DCT) can be 
utilized for the decoding. 

hi one development, which effects a simplification of the method, the 
image blocks are arranged in rows and columns and/or column numbers are 

15 assigned to the columns and row numbers are assigned to the rows. The 

allocation expediently ensues such that the first value of the appertaining image 
sub-block is the row number of the appertaining image block and the second value 
of the appertaining image sub-block is the column number of the appertaining 
image block. 

2 0 hi another development, an image sub-block exhibits a different shape 

than the appertaining image block. Preferably, the shape of the image sub-block 
is a triangle that has a right angle. Such a shape of an image sub-block reduces 
the calculating outlay for a shape-adaptive transformation encoding. 

The image sub-blocks are preferably combined to form the image. The 
2 5 image thus comprises only picture elements that contain encoding information 
relevant for an object. 

It is also advantageous to modify the image sub-blocks such that the 
relative position of an image sub-block is respectively identical with respect to the 



-15- 



appertaining image block. A shape-adaptive transformation encoding can thus be 
appUed in the framework of an encoding and/or an inverse transformation 
encoding can be apphed in the framework of a decoding, being appUed to all 
image sub-blocks of the appertaining image block. 
5 One development is utiUzed in the framework of an encoding and/or 

decoding of the image. 

It is thereby advantageous to encode the image sub-blocks with a shape- 
adaptive transformation encoding upon employment of the encoding information 
and/or upon employment of the first value, second value and third value and/or to 
1 0 decode the image sub-blocks with an inverse shape-adaptive transformation 
encoding. An efficient encoding and/or decoding of the image is thereby 
achieved. 

A simphfication derives when, in one development, a Shape- Adaptive 
Discrete Cosine Transformation (S A-DCT) for encoding and/or an inverse S A- 
1 5 DCT for decoding is/are employed. 

A further simphfication derives when a Triangle-Adaptive Discrete Cosine 
Transformation (TA-DCT) for encoding and/or an inverse TA-DCT for decoding 
is/are employed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

2 0 An exemplary embodiment of the invention is shown in the Figures and is 

explained in greater detail below. 

Figure 1 shows an arrangement for image encoding and image decoding 
with a registration of an object with a camera and a presentation of the object on a 
picture screen; 

2 5 Figure 2 is a flow chart that illustrates the procedure for image encoding 

and image decoding with a registration of an object with a camera and a 
presentation of the object on a picture screen; 
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Figures 3 A and 3B show a triangular grid structure of a three-dimensional 
model with an appertaining structure map; 

Figure 4 is a schematic illustration of a superstructure map; 

Figure 5 is a schematic illustration of a transformation of a structure map 
5 onto a triangular structure map; 

Figure 6 is a schematic illustration of a superstructure map composed of 
triangular structure maps; 

Figure 7 is a functional block diagram of arrangement for image encoding 
or, respectively, image decoding with a camera, two computers and a transmission 
1 0 medium; 

Figure 8 is a functional block diagram of an arrangement for block-based 
image encoding or, respectively, image decoding; 

Figure 9 is an illustration of the resolution of the block-shaped structure 

map. 

1 5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 shows an arrangement for an image encoding and an image 
decoding with a registration of an object with a camera and a presentation of the 
object on a picture screen. 

Figure 1 shows a camera 101 with which images of an object 152 are 
2 0 registered. The camera 101 is an analog color camera that registers images of the 
object 152 and transmits the images to a first computer 102 in analog form. In the 
first computer 102, the analog images are converted into digitalized images, 
whereby picture elements of the digitalized images contain color information of 
the object 152, and the digitaUzed images are processed. 
2 5 The object 152 is arranged centered on an object carrier 153. The relative 

position of the object carrier 153 with respect to the camera 101 is permanently 
prescribed. By rotating the object carrier 153 around its center, the object 152 can 
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be moved such that the angle of view from which the camera 101 registers the 
object 152 changes continuously given an unmodified distance of the object 152 
fi'om the camera lOL 

The first computer 102 is configured as an autonomous arrangement in the 
5 form of an autonomous computer card that is installed in the first computer 102, 
the method steps described below being implemented with the computer card. 

The first computer 102 comprises a processor 104 with which the method 
steps of image encoding described below are implemented. The processor unit 
104 is coupled via a bus 105 to a memory 106 in which image information is 
1 0 stored. 

The method for image encoding described below is realized in software. It 
is stored in the memory 106 and is implemented by the processor 104, 

After the image encoding has ensued in the first computer 101 and after a 
transmission of the encoded image information via a transmission medium 107 to 
15 a second computer 108, the image decoding is implemented in the second 

computer 108. Subsequently, a model of the object 152 is presented on a picture 
screen 155 linked to the second computer 108 upon employment of the decoded 
image information of the object 152. 

The second computer 108 has the same structure as the first computer 101. 
2 0 The second computer 108 also comprises a processor 109, the processor being 
coupled to a memory 110 with a bus 111. 

The method described below for the image decoding is realized in 
software. It is stored in the memory 110 and is implemented by the processor 
109. 

2 5 Figure 2 schematically shows the procedure for a processing of a 

digitalized image in the fi-amework of an encoding and of a decoding with a 
registration of an object with a camera and a presentation of the object on a 
picture screen. 
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This procedure for the encoding and the decoding is reahzed by the 
arrangement shown in Figure 1 and described above. 

1'* Step Registration of the Object (201) 

Upon employment of the camera 101 as described in the publication by W. 
Niem et al., "Mapping texture from multiple Camera Views onto 3D Object 
Models for Computer Animation", Proc, of hitemational Workshop on 
Stereoscopic and Three Dimensional Imaging, images of the object 152 are 
registered, said object 152 being rotated in its position relative to the camera 101 
in predetermined rotational angles with the object carrier 153. The images are 
transmitted to the first computer 102 in analog form. 

Before the implementation of the registration of the object 152, the camera 
101 is calibrated, as described in the pubhcation by W. Niem et al., "Mapping 
texture from multiple Camera Views onto 3D Object Models for Computer 
Animation", Proc. of hitemational Workshop on Stereoscopic and Three 
Dimensional hnaging, whereby a spatial geometry of the arrangement as well as 
the exposure parameters of the camera 101, for example the focal length of the 
camera 101, are defined. 

The geometry data as well as the camera parameters are transmitted to the 

first computer 102. 

2. Digitalizing the Images (202) 

The analog images are converted into digitalized images in the first 
computer 102 and the digitalized images are processed. 
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3. Image Processing (203) 

The processing of the digitalized images 103 ensues according to the 
method of automatic three-dimensional modeling upon employment of a plurality 
of images of the object, as described in the publication by W. Niem et al., 
5 "Mapping texture from multiple Camera Views onto 3D Object Models for 
Computer Animation'', Proc. of International Workshop on Stereoscopic and 
Three Dimensional Imaging. 

Two method steps are implemented in the framework of the method of 
automatic three-dimensional modeling upon employment of a plurality of images 
10 of an object: 

In the first step of the method, a volume model 301 of the object 152 is 
determined with a method for determining a contour of an object in a digitalized 
image, as cited in the publication by W. Niem et al., "Mapping texture from 
multiple Camera Views onto 3D Object Models for Computer Animation", Proc. 
15 of International Workshop on Stereoscopic and Three Dimensional Imaging, upon 
employment of the camera parameters and of the digitaUzed images 103. 

The volume model 301 of the object 152, as shown in Figure 3, is 
composed of a spatial, triangular grid structure 301, whereby the comer points 
302 of the triangles 303 are present as points 304 of a Cartesian coordinate system 
20 305. 

In the second step of the method, what is referred to as a structure map 
306 is determined for each triangle 303 upon employment of the digitalized 
images 1 03 as well as of the color information contained in pictxrre elements of 
the digitalized images 103. 
2 5 The structure map is constructed of picture elements 307 arranged block- 

like. Each picture element 307 contains a color information (chrominance values) 
of the object 152. 

The color information is allocated to the triangle 303 in that an 
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appertaining picture element 307 of the appertaining structure map 306 is 
respectively allocated to a comer point 302 and 308 of the triangle 303 and 309. 

The position of the comer points 308 of the triangle 309 is determined by 
the specification of coordinates (u^, 3 1 0 in a two-dimensional coordinate 
5 system (u, v) 3 1 1 that is allocated to the stmcture map 306. The coordinates (u^, 
310 are subsequently normed. 

Via a transformation mle, the corresponding point 310 in the appertaining 
stmcture map 306 is assigned to each comer point 302 of each triangle 303 of the 
three-dimensional model 301. 
1 0 Those picture elements 501 of a stmcture map that contain a color 

information relevant for the presentation of the object 152 are transformed into a 
new triangular stmcture map 503. The picture elements 506 of the triangular 
stmcture map are arranged such that they form a right-angle and equilateral 
triangle, whereby one side comprises five picture elements. The transformation is 
15 implemented such that the picture elements 501 that are comer picture elements 
504 of the triangle 505 coincide with picture elements 506 that are comer picture 
elements 507 of the triangular stmcture map 503. 

In the framework of the transformation, picture elements may potentially 
have to be generated by an extrapolation or an interpolation of values that contain 
2 0 color information or picture elements may potentially have to be deleted. 

The triangular stmcture map 503 thus comprises only picture elements 506 
that are relevant for the presentation of an object. 

As shown in Figure 6, all triangular stmcture maps 601 that contain the 
color information relevant for the presentation of the object are arranged to form a 
2 5 new superstmcture map 602. 

To that end, respectively two triangular stmcture maps 601 are arranged to 
form a block-shaped stmcture map 603. Further, all block-shaped stmcture maps 
603 are groups by rows and columns, whereby a digitalized image is generated. 
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Due to the uniform and predetermined shape of the triangular structure 
map, the row-by-row and column-by-colunm arrangement of the block-shaped 
structure maps 603 and a predetermined size of the superstructure map 602, a 
simplified transformation rule or, respectively, a simphfied allocation key derives 
5 that is referred to as texture binding: 

Each triangle 303 of the spatial triangular grid structure 301 of the three- 
dimensional model of the object 152 has allocated to it a first value Ug that 
indicates the column number of the triangular structure map 601 belonging to the 
triangle 303 within the superstructure map 602, a second value n^ that indicates 

1 0 the row number of the triangular structure map 601 belonging to the triangle 303 
within the superstructure map 602, and a third value % that indicates the relative 
position of the triangular structure map 601a or, respectively, 601b with respect to 
the block-shaped structure map 603. 

Upon employment of the value triad (ug, %, n^ indicated for each triangle 

1 5 303 of the spatial grid structure 301 and of the given values in view of the height 
H (plurality of picture elements, for example 80 picture elements) of the 
superstructure map having the size HxB and of the given plurahty of picture 
elements Z arranged in a side of the right equilateral triangle with, for example, 
Z=5 picture elements, an allocation of a triangular structure map 601 of the 

2 0 superstructure map 602 to the appertaining triangle 303 of the volume model 301 
of the object is determined according to the following relationships: 

A, = (Z/B)*(ns-l) 

A, = (Z/H)*(%-1) 

B, = (Z/B)*ns 
25 B,-A, 

C, = (Z/H)*nz 
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The comer picture elements (Ax Ay), (Cx,Cy) and (Dx,Dy) are relevant 
for the value nL = 0 that describes a triangular structure map 601a arranged at the 
left within the block-shaped structure map 603. 
5 The comer points (A,,Ay), C,,Cy) and (B^,By) are relevant for the value % 

- 1 that describes a triangular stracture map 601b arranged at the left within the 
block-shaped stmcture map 603. 

The two values that are identified by the index x and by the index y 
thereby indicate the coordinates of a point of the superstracture map 602 with 
1 0 respect to a Cartesian coordinate system 610 that is arranged in the upper left 
comer 611 of the superstmcture map 602. 

4. Encoding (204) 

What is referred to as a Triangle- Adaptive Discrete Cosine Transformation 
(TA-DCT) is employed for the encoding of the superstmcture map 602. This 
1 5 method for encoding a digitalized image is based on the method of a Shape- 
Adaptive Discrete Cosine Transformation (SA-DCT) as described in] the 
pubUcation by T. Sikora et al., "Shape Adaptive DCT for Generic Coding of 
Video", IEEE Transactions on Circuits and Systems for Video Technology. 

In the fi-amework of a TA-DCT, the transformation coefficients allocated 
2 0 to an image object are defined such that picture elements of an edge image block 
that do nor belong to the image object are blanked out. A one-dimensional DCT, 
whose length corresponds to the number of picture elements remaining in the 
respective column, is then first applied column-by-column to the remaining 
picture elements. The resulting transformation coefficients are subsequently 
2 5 subjected to a fiirther one-dimensional DCT in horizontal direction with a 
corresponding length. 

The method of TA-DCT proceeds fi-om a transformation matrix DCT-N 
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having the following structure: 



DCT- N(p,k) = r *cos p 




(1) 



withp,k = 0->N-l. 

N references a quantity of the image vector to be transformed wherein the 



DCT-N references a transformation matrix having the size NxN. 
p, k reference indices with p, k e [0, N-1]. 

After the TA-DCT, each column of the image block to be transformed is 
vertically transformed according to the rule 



Subsequently, the same rule is appUed to the resultant data in horizontal direction. 

In the framework of the encoding of a superstructure map 602 upon 
employment of TA-DCT, the superstructure map 62 is subdivided into the block- 
shaped structure maps 603, A block-shaped structure map 603 and 901 is thereby 

1 5 divided into a first new block-shaped structure map 902 and a second new block- 
shaped structure map 903, as shown in Figure 9, in that the picture elements of the 
second triangular structure map 601b and 904 are deleted for the determination of 
the first new block-shaped structure map 602. The second new block-shaped 
structure map 903 is determined in that the picture elements of the fu-st triangular 

2 0 structure map 601a and 905 are deleted. 

Further, the second new block-shaped structure map 903 is modified such 
by shifting picture elements 906 that the relative position of the picture elements 
906 of the second block-shaped structure map 903 with respect to the second new 



5 



transformed picture elements are contained. 



10 




block-shaped structure map 903 coincides with the relative position of the picture 
elements 907 of the first new block-shaped structure map 902 with respect to the 
first new block-shaped structure map 902. 

The TA-DCT can thus be correspondingly appUed to the first new block- 
shaped structure map 902 and to the second new block-shaped structure map 903. 

The TA-DCT can be utihzed due to the specific relative position of the 
picture elements 906 and 907 with respect to the first new block-shaped structure 
map 902 and the second new block-shaped structure map 903, 

5, Transmission (205) 

The image information (image information of the superstructure map) 
encoded upon employment of the TA-DCT is transmitted via a transmission 
medixmi 107 to the second computer 108 together with data of the volume model 
of the object as well as of the allocation (ng, nj^ (i = 1 ... N, with N = number 
of triangles of the grid structure of the volume model). 

6. Decoding (206) 

An image decoding is implemented after transmission of the encoded 

image information. 

To that end, the spectral coefficients Cj are supplied to an inverse TA- 
DCT. 

Given inverse TA-DCT in the framework if image encoding in the intra- 
image encoding mode, picture elements Xj are formed from the spectral 
coefficients Cj according to the following rule (4): 




(4) 



whereby the transformation matrix DCT-N comprises the following structure: 
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DCT~ N (p,k) = J *cos 

withp,k = 0 - N-1. 
whereby 

~ N references a size of the image vector to be transformed wherein the picture 
elements to be transformed are contained; 

~ [ DCT-N (p, k)] references a transformation matrix having the size NxN; 

— p, k reference indices with p, k e [0, N-1]; 

— ( Y references an inversion of a matrix. 
The decoded image or, respectively, the superstructure map 602 is 

determined upon employment of the determined picture elements Xj. 

7. Presentation of the Object (207) 

The model of the object 152 is presented on the picture screen 108 upon 
employment of the superstructure map, the data of the volume model of the object 
152 as well as the allocation(ns, nj^ (i = 1 ... N, with N = number of triangles 
15 of the grid structure of the volume model), as described in the hitemet pubhcation 
PANORAMA technical Support, available on 12 October 1998 at: 
http://vmw.tnt.uni-hannover.de/proiect/eu/panorama/TS.htmL 

Although other modifications and changes may be suggested by those 
skilled in the art, it is the intention of the inventors to embody within the patent 
2 0 warranted hereon all changes and modifications as reasonably and properly come 
v^thin the scope of their contribution to the art. 



(1) 
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IN THE CLAIMS 

The claims have been amended as follows: 
I claim: 

1 . (Amended) A method for processing a digitalized image with picture 
5 elements that contain an encoding information, comprising the steps of: 

dividing the image is at least partially into image blocks; 

subdividing an appertaining image block respectively into at least two 
appertaining image sub-blocks; 

implementing processing of the image such that a first value and a second value 
1 0 and a third value are respectively allocated to at least one image sub-block, 

the first value and the second value describe the relative position of the 
appertaining image block with respect to the image and the third value 
describes the relative position of the appertaining image sub-block with 
respect to the appertaining image block. 



15 2. (Amended) A method according to claim 1, wherein said step of 

subdividing provides that the appertaining image block is subdivided into a 
plurality of appertaining image sub-blocks. 

3. (Amended) A method according to claim 1, wherein said step of 
implementing provides that the first value and the second value and the third 
2 0 value are respectively allocated to each appertaining image sub-block. 



4, (Amended) A method according to claim 1, wherein the image blocks 
are arranged in colunms and rows. 

5. (Amended) A method according to claim 29, wherein a first value of the 
appertaining image sub-block is the row number of the appertaining image block 



and a second value of the appertaining image sub-block is the column number of 
the appertaining image block. 

6. (Amended) A method according to claim 1, wherein the appertaining 
image sub-blocks exhibit a different shape than the appertaining image block. 

7. (Amended) A method according to claim 1, wherein the image sub- 
blocks are of a triangular shape. 

8. (Amended) A method according to claim 7, wherein the triangular 
shape includes a right angle. 

9. (Amended) A method according to claim 1, further comprising the step 

of: 

modifying the appertaining image sub-blocks such that the respective position of 
an appertaining image sub-block with respect to the appertaining image 
block is respectively identical. 

10. (Amended) A method according to claim 1, further comprising the step 

of: 

utilizing the steps for encoding of the image. 

11. (Amended) A method according to claim 10, further comprising the 
steps of: 

encoding the image sub-blocks upon employment of the encoding information 
with a shape-adaptive transformation encoding. 

12. (Amended) A method according to claim 1 1, wherein a shape-adaptive 
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Discrete Cosine Transformation is utilized for the encoding, 

13. (Amended) A method according to claim 12, wherein a Shape- 
Adaptive Discrete Cosine Transformation is utilized for the encoding. 

14. (Amended) A method according to claim 13, wherein a Triangle- 
5 Adaptive Discrete Cosine Transformation is utilized for the encoding. 

15. (Amended) A method according to claim 1, wherein the steps are 
utilized in the framework of a decoding of the image, 

16. (Amended) A method according to claim 15, wherein an inverse 
shape-adaptive Discrete Cosine Transformation is utihzed for the decoding. 

10 17. (Amended) A method according to claim 1 6, wherein an inverse 

Shape-Adaptive Discrete Cosine Transformation is utilized for the decoding. 

18. (Amended) A method according to claim 17, wherein an inverse 
Triangle- Adaptive Discrete Cosine Transformation is utilized for the decoding. 

19. (Amended) A method according to claim 1, wherein the unage at least 
1 5 partly includes triangular structure maps. 

20. (Amended) An arrangement for processing a digitalized image with 
picture elements that contain an encoding information, comprising: 

a processor that is configured such that the following method steps can be 
implemented: 

2 0 the image is at least partially divided into image blocks; 



an appertaining image block is respectively subdivided into at least two 

appertaining image sub-blocks; 
the processing of the image is implemented such that a first value and a second 
value and a third value are respectively allocated to at least one image sub-block, 
the first value and the second value describe the relative position of the 
appertaining image block with respect to the image and the third value describes 
the relative position of the appertaining image sub-block with respect to the 
appertaining image block. 

21. (Amended) An arrangement according to claim 20, wherein the 
appertaining image block is subdivided into a plurality of appertaining image sub- 
blocks. 

22. (Amended) An arrangement according to claim 20, wherein the 
respective first value and the respective second value and the respective third 
value are allocated to each appertaining image sub-block. 

23. (Amended) An arrangement according to claim 20, wherein the 
processor is utilized in an encoding of the image. 

24. (Amended) An arrangement according to claim 23, wherein a shape- 
adaptive Discrete Cosine Transformation is utilized for the encoding, 

25. (Amended) An arrangement according to claim 24, wherein an inverse 
Triangle- Adaptive Discrete Cosine Transformation is utilized for the encoding. 

26. (Amended) An arrangement according to claim 20, wherein the 
processor is utilized in the fi"amework of a decoding of the image. 



27. (Amended) An arrangement according to claim 26, wherein an inverse 
shape-adaptive Discrete Cosine Transformation is utilized for the decoding. 

28. (Amended) An arrangement according to claim 27, wherein an inverse 
Triangle- Adaptive Discrete Cosine Transformation is utilized for the decoding. 

29. A method according to claim 1, further comprising the step of: 
assigning column numbers to the columns and row numbers to the rows. 

30. A method according to claim 10, further comprising the steps of: 
encoding the image sub-blocks upon employment of the first value and the second 

value and the third value with a shape-adaptive transformation encoding. 
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IN THE ABSTRACT 

The abstract has been amended as follows: 
Abstract of the Disclosure 

Methods and arrangements are recited for processing a digitalized image 
5 with picture elements that contain an encoding information. To that end, the 

image is divided into image blocks and a respective image block is divided into 
two image sub-blocks. The processing of the image is implemented such that a 
respective first value and a respective second value and a respective third value is 
allocated to an image sub-block, whereby the first value and the second value 
1 0 describe the relative position of the appertaining image block with respect to the 
image and the third value describes the relative position of the appertaining image 
sub-block with respect to the appertaining image block. Further, the employment 
of the method and of the arrangement in the framework of an encoding and 
decoding is recited. 
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REMARKS 

The foregoing amendments to the specification and claims under Article 
41 of the Patent Cooperation Treaty place the application into a form for 
prosecution before the U.S. Patent and Trademark Office imder 35 U.S.C, §371. 
5 Accordingly, entry of these amendments before examination on the merits is 
hereby requested. 



Respectfully submitted, 

Melvin A, Robinson (reg. no. 31,870) 
1 0 Patent Department 

Schiff Hardin & Waite 
6600 Sears Tower 
Chicago, Illinois 60606 
Telephone: 312-258-5785 



15 



ATTORNEY FOR APPLICANT 



-33- 



VERSION MARKED TO SHOW CHANGES 
The marked up version showing the amendments follows: 

SPECIFICATION 
TITLE 

5 METHOD AND ARRANGEMENT FOR PROCESSING A DIGITALIZED 
IMAGE 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention is directed to an arrangement and to a method for 

1 0 processing a digitalized image as utilized and implemented in the framework of 
an encoding and decoding of a digitalized image. 

Such a method and such an arrangement are utilized in the framework of 
an encoding and decoding of a digitahzed image corresponding to one of the 
image encoding standards H.261 [f^] the pubhcation by D. Le Gall ''The Video 

15 Compression Standard for Multimedia Applications", Communications of ACM . 
H.263 [pj] the publication by G. Wallace. "The JPEG Still Picture Compression 
Standard", Communications of ACM of MPEG2 [f^J] the publication by De 
Lameillieure, J. et al. ''MPEG-2-Bildcodierung fur das digitale Femsehen" in 
FERNSEH- UND KINO-TECHNIK that are based on the principle of a block- 

2 0 based image encoding. According to [f3^] the publication by De Lameilheure, J. 
et al.. "MPEG-2-Bildcodierung fur das digitale Femsehen" in FERNSEH- UND 
KINO-TECHNIK, the method of a block-based discrete cosine transformation 
(DCT) is employed for block-based image encoding. 

Another approach for processing a digitalized image corresponding to the 

2 5 image encoding standard MPEG4 is what is referred to as the principle of object- 
based image encoding, as known from [f3f] the publication by De Lameillieure, J. 
et al.. ''MPEG-2-Bildcodierung for das digitale Femsehen'' in FERNSEH- UND 
KINO-TECHNIK . 
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In object-based image encoding, a segmentation of an image master into 
image blocks ensues corresponding to objects occurring in a scene, and a separate 
encoding of these objects ensues. 

Components of a standard arrangement for an image encoding, as also 
5 known from [f?}] the publication by W. Niem. et al.. "Mapping texture from 

multiple Camera Views onto 3D Object Models for Computer Animation". Proc. 
of International Workshop on Stereoscopic and Three Dimensional Imaging, and 
of an image decoding can be derived from Figure 7. 

Figure 7 shows a camera 701 with which images are registered. The 
1 0 camera 701 can, for example, be an arbitrary analog camera 701 that registers 
images of a scene and either digitalizes the images in the camera 701 and 
transmits the digitalized images to a first computer 702 that is coupled to the 
camera 701 or transmits the images to the first computer 702 in analog form as 
well. In the first computer 702, the analog images are converted into digitalized 
1 5 images and the digitaUzed images are processed. 

The camera 701 can also be a digital camera 701 with which directly 
digitalized images are registered and supplied to the first computer 702 for further 
processing. 

The first computer 702 can also be designed as an autonomous 
2 0 arrangement with which the method steps described below are implemented, for 
example as an autonomous computer card that is installed in a further computer. 

What is to be generally understood by the first computer 702 is a unit that 
can implement an image signal processing according to the method described 
below, for example a mobile terminal device (mobile telephone with a picture 
2 5 screen). 

The first computer 702 comprises a processor unit 704 with which the 
method steps of the image encoding and image decoding described below are 
implemented. The processor unit 704, for example, is coupled via a bus 705 to a 
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memory 706 in which an image information is stored. 

In general, the methods described below can be realized both in software 
as well as in hardware or partly in software and partly in hardware. 

After the image encoding has ensued in the first computer 701 and after 
5 the transmission of the encoded image information via a transmission medium 
707 to a second computer 708, the image decoding is implemented in the second 
computer 708. 

The second computer 708 can have the same structure as the first 
computer 701, The second computer 708 thus also comprises a processor 709 that 
10 is coupled to a memory 710 by a bus 71 L 

Figure 8 shows a possible arrangement in the form of a schematic diagram 
of the image encoding or, respectively, image decoding. The illustrated 
arrangement can be employed within the fi-amework of a block-based image 
encoding and — also shall be explained in greater detail later — can be employed 
15 in part within the framework of an object-based image encoding. 

In the block-based image encoding, a digitalized image 801 is divided into 
what are usually quadratic image blocks [826] 826 having a size of 8x8 picture 
elements 802 or 16x16 picture elements 802 and is supplied to the arrangement 
803 for image encoding. 
2 0 Coding information, for example brightness information (luminance 

values) and/or color information (chrominance values), is usually allocated to a 
picture element 802, 

hi block-based image encoding, a distinction is made between different 
image encoding modes. 
2 5 hi what is referred to as intra-image encoding, the digitalized image 801 is 

respectively encoded with the coding information allocated to the picture elements 
802 of the digitalized image and is transmitted. 

hi what is referred to as an inter-image encoding, only a difference image 
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information of two chronologically successive, digitalized images 801 is 
respectively encoded and transmitted. 

The difference information is very small when movements of image 
objects are slight in the chronologically successive, digitalized images 801. When 
5 the movements are great, then a great deal of difference information arises that is 
difficult to encode. For this reason md as known from [fSj] the publication by De 
Lameillieure, J. et al., ''MPEG-2-Bildcodierung fur das digitale Femsehen'' in 
FERNSEH- UND KINO-TECHNIK , an "image-to-image" movement (motion 
estimate) is measured and compensated before the determination of the difference 

1 0 information (motion compensation). 

There are different methods for the motion estimation and the motion 
compensation as known from [f3J] the publication by De Lameillieure, J. et al.. 
"MPEG-2-Bildcodierung fur das digitale Femsehen" in FERNSEH- UND KINO- 
TECHNIK . What is referred to as a "block matching method" is usually utilized 

15 for the block-based image encoding. It is based thereon that an image block to be 
encoded is compared to reference image blocks of the same size in a reference 
image. The sum of the absolute differences of an encoding information that is 
respectively allocated to a picture element is usually employed as a criterion for a 
coincidence quality between the block to be encoded and a respective reference 

2 0 image block, hi this way, a motion information for the image block is 

determined, for example a motion vector, this being transmitted with the 
difference information. 

Two switch units 804 are provided for switching between the intra-image 
encoding and the inter-image encoding. A subtraction unit 805 wherein the 

2 5 difference of the image information of two chronologically successive, digitalized 
images 801 is formed is provided for the implementation of the inter-image 
encoding. The image encoding is controlled via an image encoding control unit 
806. The image blocks [S£0] 823 to be encoded or, respectively, difference image 
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blocks are respectively supplied to a transformation encoding unit 807, The 
transformation encoding unit 807 applies a transforation encoding, for example 
a discrete cosine transformation (DCT), to the encoding information allocated to 
the picture elements 802. 
5 In general, however, any desired transformation encoding, for example a 

discrete sine transformation or a discrete Fourier transformation, can be applied 
for the image encoding. 

Spectral coefficients (transformation coefficients) are formed by the 
transformation encoding. The spectral coefficients are quantized in a quantization 
1 0 unit 808 and are supplied to an image encoding multiplexer 821, for example to a 
channel encoding and/or to an entropy encoding. The quantized spectral 
coefficients are inversely quantized in an inverse quantization unit 809 and are 
subjected to an inverse transformation encoding in an inverse transformation 
encoding unit 810, 

15 hi the case of inter-image encoding, fiarther, image information of the 

respective, chronologically preceding image are added in an adder unit 811, The 
images reconstructed in this way are stored in a memory 812. For simpler 
presentation, a unit relating to the motion compensation 813 is symbolically 
presented in the memory 812. 

2 0 Further, a loop filter 814 is provided that is connected to the memory 812 

as well as to the subtraction unit 805, 

In addition to a transmitted image information 822, a mode index that 
respectively indicates whether an intra-image encoding or inter-image encoding 
was undertaken is also supplied to the image encoding multiplexer 821. 

2 5 Further, quantization indices 816 for the spectral coefficients are supplied 

to the image encoding multiplexer 821, 

A motion vector is respectively allocated to an image block 820 and/or to 
a macro block 823 that, for example, comprises four image blocks 820 and is 
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supplied to the image encoding multiplexer 82 L 

Further, an information particular for the activation or, respectively, 
deactivation of the loop filter is provided. After transmission of the image 
information via a transmission medium 818, the decoding of the transmitted 
5 information can ensue in a second computer 819. To this end, an image decoding 
unit 825 is provided in the second computer 819, this unit 825, for example, 
comprising the structure of a reconstruction loop of the arrangement shown in 
Figure 8. 

The pubUcation by T. Sikora et al.. "Shape Adaptive DCT for 

10 Generic Coding of Video'', IEEE Transactions on Circuits and Systems for Video 
Technology discloses a shape-adapted transformation encoding is specifically 
applied in the firamework of an object-based image encoding to edge image block 
or image blocks that contain only partially relevant encoding information. The 
edge image blocks encoded upon employment of a shape-adapted transformation 

1 5 encoding are characterized in that only the picture elements that are allocated to 
an object or, respectively, that comprise encoding information relevant to the 
object are encoded. 

The method described in [f4J] the publication by T. Sikora et al., "Shape 
Adaptive DCT for Generic Coding of Video", IEEE Transactions on Circuits and 

2 0 Systems for Video Technology is what is referred to as a shape-adapted Discrete 
Cosine Transformation (Shape- Adaptive DCT, SA-DCT). 

Within the framework of an S A-DCT, the transformation coefficients 
allocated to an image object are defined such that picture elements of an edge 
image block that do not belong to the image object are blanked out. A one- 

2 5 dimensional DCT is then initially applied to the remaining picture elements 

column-by-column, the length thereof corresponding to the number of remaining 
picture elements in the respective column. The resulting transformation 
coefficients are horizontally aligned and are [a] subsequently subject to [ in [sic] ] a 
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further one-dimensional DCT in a horizontal direction with a corresponding 
length. 

The rule of SA-DCT known from [f4f] the publication bv T. Sikora et al.. 
"Shape Adaptive DCT for Generic Coding of Video'\ IEEE Transactions on 
Circuits and Systems for Video Technology proceeds from a transformation 
matrix DCT-N having the following structure: 



DCT- N{p,k) = r *cos 



(1) 



withp,k = 0 - N-1. 

N references a quantity of the image vector to be transformed wherein the 
1 0 transformed picture elements are contained. 

DCT-N references a transformation matrix having the size NxN, 
p, k reference indices with p, k 6 [0, N-1], 

After the SA-DCT, each column of the image block to be transformed is 
vertically transformed according to the rule 

15 c. = j^* WCT- N (p,k)]*x. (2) 

Subsequently, the same rule is applied to the resultant data in a horizontal 
direction. 

Various methods for the presentation of an object on a picture screen are 
employed in computer graphics. One method for the presentation of a subject is 
2 0 what is referred to as texture mapping. 

[f5r]] the publication bv J.D. Foley et al.. "Computer graphics: principles 
and practise" discloses such a texture mapping. 

hi the framework of texture mapping, a digital image that contains a 
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brightness information (luminance values) and/or a color information 
(chrominance values) of the object to be presented is mapped onto a surface of a 
three-dimensional model of an object to be presented. 

The three-dimensional model 301 of the object to be presented, [said] the 
5 model 301 being shown in Figure 3 A, is composed of a spatial, triangular grid 
structure 301, whereby the comer points 302 of the triangles 303 are present as 
points 304 of a Cartesian coordinate system 305. 

As shown in Figure 3B, what is referred to as a block-shaped structure 
map 306 is allocated to each triangle 303, as shown in Figure 3B, [said] tiie map 
1 0 306 being constructed of picture elements 307 that are arranged rectangularly or, 
respectively, block-like. A brightness information (luminance values) and/or a 
color information (chrominance values) is usually allocated to each picture 
element 307. 

The brightness or color information is allocated to the triangle 303 such 
15 that an appertaining picture element 307 of the appertaining structure map 306 is 
respectively allocated to a comer point 302 and 308 of the triangle 303 and 309. 

The position of a comer point 308 of the triangle 309 is defined by the 
indication of coordinates (u^, vj 310 in a two-dimensional coordinate system (u, 
v) 31 1 that is assigned to the stmcture map 306. The coordinates (u^, v^) 310 are 
2 0 usually normed. 

Via a transformation mle (allocation or, respectively, allocation key), the 
corresponding point 310 in the appertaining structure map 306 is allocated to each 
comer point 302 of each triangle 303 of the three-dimensional model 301. 

As shown in Figure 4, further, all stmcture maps 401 are combined into a 
2 5 digitalized image 402, what is referred to as a superstmcture map 402, wherein 
the individual stmcture maps 401 are arranged row-by-row and column-by- 
column. As warranted, the stmcture maps 401, which contain encoding 
information relevant for the presentation of the object, must be supplemented with 
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structure maps 404 that contain no encoding information that is relevant for the 

presentation of the subject. 

In particular, however, the above-described method exhibits a 

disadvantage. The structure maps and the superstructure maps as well comprise 
5 picture elements that contain no brightness or color information relevant for the 

representation of the object. 

When the superstructure map is encoded in the framework of an image 

transmission, then the data rate occurring in the transmission is unnecessarily 

increased by the non-relevant picture elements. 
1 0 For improving the above method, a structure map is processed in the 

following way (see Figure 5): 

Those picture elements 501 of a structure map 502 that contain picture 

elements [f^r^] of an encoding information relevant for the presentation of the 

object are transformed into a new triangular structure map 503 with picture 
1 5 elements 506 that are arranged in a predetermined shape ~ usually a right triangle 

~ and in a predetermined size. The transformation is implemented such that the 

picture elements 501, which are comer picture elements 504 of the triangle 505, 

coincide with picture elements 506 that are comer picture elements 507 of the 

triangular structure map. 
2 0 hi the scope of the transformation, picture elements may potentially have 

to be generated by an extrapolation or an interpolation of values that contain a 

brightness or color information or picture elements may potentially have to be 

deleted. 

The triangular structure map 503 thus only comprises picture elements 506 
2 5 that are relevant for the presentation of an obj ect. 

As shown in Figure 6, all triangular structure maps 601 that contain 
brightness or color information relevant for the presentation of the object are 
arranged to form a new superstructure map 602, 



To that end, respectively two triangular structure maps 601a and 601b are 
arranged to form a block-shaped structure map 603. 

Further, all block-shaped structure maps 603 are grouped by rows and 
columns, a digitalized image being thus generated. 

[fSf] the pubUcation bv J.D. Foley et al., "Computer g raphics: principles 
and practise" also discloses that such a superstructure map as generated in the 
framework of a texture mapping is encoded and decoded in an image 
transmission. 

The encoding and/or decoding of a superstructure map thereby usually 
ensues upon employment of a block-oriented transformation in the intra-image 
encoding mode, as was set forth above. 

As implemented in the framework of a processing of a digital image, this 
procedure is not very efficient in view of a low data rate to be desired for a 
transmission or in view of a higher image quality. 

SUMMARY OF THE INVENTION 

The invention is thus based on the problem of specifying a method for 
processing a digitalized image and an arrangement for processing a digitalized 
image with which a more efficient processing of a digitaHzed image becomes 
possible. 

[ The problem is solved by the method comprishig the fcaluics according 
to th e independent claims as w-ell as by the ai - rangemcnls comprising the fcatui ' cs 
according to the independent claims. ] 

The problems of the prior art are addressed bv a method f or processing a 
digitalized image with picture elements that contain an encodin g information, 
a) wherebv the image is at least partiallv divided into im age blocks: 
b} wherebv an appertaining image block is respectively subdivided into at 

least two appertaining image sub-blocks: 
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wherein the processing of the image is implemented such that a first value, a 
second value and a third value are respectively allocated to at least one image sub- 
block, whereby the first value and the second value describe the relative position 
of the appertaining image block with respect to the image and the third value 
5 describes the relative position of the appertaining image sub-block with respect to 
the appertaining image block. The problems of the prior art are also addressed by 
an arrangement for processing a digitalized image with picture elements that 
contain an encoding information, whereby a processor is provided that is 
configured such that the following method steps can be implemented: 

10 al the image is at least partially divided into image blocks: 

b} an appertaining image block is respectively subdivided into at least two 

appertaining image sub-blocks; 
wherein the processing of the image is implemented such that a first value, a 
second value and a third value are respectively allocated to at lea st one image sub- 

15 block, whereby the first value and the second value describe the re lative position 
of the appertaining image block with respect to the image and the third value 
describes the relative position of the appertaining image sub-block with respect to 
the appertaining image block. 

In the method for processing a digitalized image with picture elements that 

2 0 contain an encoding information, the image is at least partly divided into image 

blocks. Respectively one image block is subdivided into at least two appertaining 
image sub-blocks. The processing of the image is implemented such that a first 
value, a second value and a third value are respectively allocated to at least one 
appertaining image sub-block, whereby the first value and the second value 

2 5 describe the relative position of the appertaining image block with respect to the 
image and the third value describes the relative position of the appertaining image 
sub-block with respect to the appertaining image block. 

hi the arrangement for processing a digitahzed image having picture 
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elements that contain an encoding information, a processor is provided that is 
configured such that the following method steps can be implemented: 
The image is at least partially divided into image blocks. Respectively one image 
block is subdivided into at least two appertaining image sub-blocks. The 
5 processing of the image is implemented such that a first value, a second value and 
a third value are respectively allocated to at least one of the appertaining image 
sub-blocks, whereby the first value and the second value describe the relative 
position of the appertaining image block with respect to the image and the third 
value describes the relative position of the appertaining image sub-block with 
1 0 respect to the appertaining image block. 

[ Piefcrrcd developments of the invention derive from the dependent 
claims. ] 

Tn the method, the appertaining image block mav be subdivided into a 
pluralitv of appertaining image sub-blocks. The first value, the second value and 

15 the third value are respectivelv allocated to each appertai ning image sub-block. 

The image blocks mav be arranged in columns and row s and/or column numbers 
mav be assigned to the colunms and row numbers are assig ned to the rows. The 
first value of the appertaining image sub-block is th e row number of the 
ap pertaining image block and the second value of the appertaining image s ub- 

2 0 block is the column number of the appertaining i mage block. The appertaining 

image sub-blocks mav exhibit a different shape than t he appertaining image block. 
The image sub-blocks can comprise a triangular s hape. Preferablv. the triangular 
sha pe comprises a right angle, hi the method, the ap pertaining image sub-blocks 
are modified such that the respective position of an appertaining image sub-block 

2 5 with respect to the appertaining image block is respectively identical, hi a 

preferred embodiment, the method is utiUzed in th e fi-amework of an encoding of 
the image. The image sub-blocks are encoded upon emplo yment of the encoding 
information and/or upon employment of the first value, the second value a nd the 
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tbird value with a shape-adaptive transformation encoding. In one embo diment, a 
shape-adaptive Discrete Cosine Transformation (DCT) is utilized for the 
encoding. Specifically, a Shane-Adaptive Discrete Cosine Transform ation (SA- 
DCT) is utilized for the encoding. Further, a Triangle- Adaptive Discrete Cosine 
5 Transformation TTA-DCT^ is utihzed for the encoding. T he method may be 
utilized in the fi-amev^ork of a decoding of the image, hi pa rticular, an inverse 
shape-adaptive Discrete Cosine Transformation (DCT) is utilized for the 
decoding. Further, an inverse Shape-Adaptive Discrete Cosine Tran sformation 
rSA-DCT^ is utilized for the decoding. In particular, an inverse Triangle- 

10 Adaptive Discrete Cosine Transformation TTA-DCTl is uti lized for the decoding. 
In the method, the image at least partly comprises trian gular structure maps. 

The foregoing method of a preferred embodiment provides that the 
appertaining image block can be subdivided into a plurality of apper taining image 
sub-blocks. The respective first value and the respective se cond value and the 

15 respective third value can be allocated to each appertaining ima ge sub-block. The 
arrangement can be utilized in the framework of an encod ing of the image. A 
shape-adaptive Discrete Cosine Transformation (BCT) can be utilized for the 
encoding. For example, an inverse Triangle- Adaptive D iscrete Cosine 
Transformation TTA-DCT^ can be utihzed for the encoding. The arran gement can 

2 0 be utilized in the fi-amework of a decoding of the image . An inverse shape- 
adaptive Discrete Cosine Transformation fDCT) can be utilized for the decoding. 
The inverse Triangle- Adaptive Discrete Cosine Transformation (TA -DCTl can be 
utiUzed for the decoding. 

In one development, which effects a simplification of the method, the 

2 5 image blocks are arranged in rows and columns and/or colunm numbers are 
assigned to the columns and row numbers are assigned to the rows. The 
allocation expediently ensues such that the first value of the appertaining image 
sub-block is the row number of the appertaining image block and the second value 
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of the appertaining image sub-block is the coliimn number of the appertaining 
image block. 

In another development, an image sub-block exhibits a different shape 
than the appertaining image block. Preferably, the shape of the image sub-block 
5 is a triangle that has a right angle. Such a shape of an image sub-block reduces 
the calculating outlay for a shape-adaptive transformation encoding. 

The image sub-blocks are preferably combined to form the image. The 
image thus comprises only picture elements that contain encoding information 
relevant for an object, 
10 It is also advantageous to modify the image sub-blocks such that the 

relative position of an image sub-block is respectively identical with respect to the 
appertaining image block. A shape-adaptive transformation encoding can thus be 
applied in the framework of an encoding and/or an inverse transformation 
encoding can be apphed in the framework of a decoding, being apphed to all 
1 5 image sub-blocks of the appertaining image block. 

One development is utilized in the framework of an encoding and/or 
decoding of the image. 

It is thereby advantageous to encode the image sub-blocks with a shape- 
adaptive transformation encoding upon employment of the encoding information 
2 0 and/or upon employment of the first value, second value and third value and/or to 
decode the image sub-blocks with an inverse shape-adaptive transformation 
encoding. An efficient encoding and/or decoding of the image is thereby 
achieved. 

A simplification derives when, in one development, a Shape- Adaptive 
2 5 Discrete Cosine Transformation (SA-DCT) for encoding and/or an inverse SA- 
DCT for decoding is/are employed. 

A ftirther simpUfication derives when a Triangle- Adaptive Discrete Cosine 
Transformation (TA-DCT) for encoding and/or an inverse TA-DCT for decoding 



-47- 



is/are employed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

An exemplary embodiment of the invention is shown in the Figures and is 
explained in greater detail below. 
5 [ Shown arc: ] 

Figure 1 shows an arrangement for image encoding and image decoding 
with a registration of an object with a camera and a presentation of the object on a 
picture screen; 

Figure 2 is a flow chart that illustrates [ schematic illustration of] the 
1 0 procedure for image encoding and image decoding with a registration of an object 
with a camera and a presentation of the object on a picture screen; 

Figures 3 A and 3B show a triangular grid structure of a three-dimensional 
model with an appertaining structure map; 

Figure 4 is a schematic illustration of a superstructure map; 
1 5 Figure 5 is a schematic illustration of a transformation of a structure map 

onto a triangular structure map; 

Figure 6 is a schematic illustration of a superstructure map composed of 
triangular structure maps; 

Figure 7 is a functional block diagram of arrangement for image encoding 
2 0 or, respectively, image decoding with a camera, two computers and a transmission 
medium; 

Figure 8 is a functional block diagram [ sk e tch ] of an arrangement for 
block-based image encoding or, respectively, image decoding; 

Figure 9 is an illustration of the resolution of the block-shaped structure 

2 5 map. 
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Figure 1 shows an arrangement for an image encoding and an image 
decoding with a registration of an object with a camera and a presentation of the 
object on a picture screen. 

Figure 1 shows a camera 101 with which images of an object 152 are 
registered. The camera 101 is an analog color camera that registers images of the 
object 152 and transmits the images to a first computer 102 in analog form, [in] 
hi the first computer 102, the analog images are converted into digitalized images, 
whereby picture elements of the digitahzed images contain [a] color information 
of the object 152, and the digitalized images are processed. 

The object 152 is arranged centered on an object carrier 153. The relative 
position of the object carrier 153 with respect to the camera 101 is permanently 
prescribed. By rotating the object carrier 153 aroimd its center, the object 152 can 
be moved such that the angle of view from which the camera 101 registers the 
object 152 changes continuously given an unmodified distance of the object 152 
from the camera 101. 

The first computer 102 is configured as an autonomous arrangement in the 
form of an autonomous computer card that is installed in the first computer 102, 
the method steps described below being implemented with [said] the computer 
card. 

The first computer 102 comprises a processor 104 with which the method 
steps of image encoding described below are implemented. The processor unit 
104 is coupled via a bus 105 to a memory 106 in which [an] image information is 
stored. 

The method for image encoding described below is reaUzed in software. It 
is stored in the memory 106 and is implemented by the processor 104. 

After the image encoding has ensued in the first computer 101 and after a 
transmission of the encoded image information via a transmission medium 107 to 
a second computer 108, the image decoding is implemented in the second 
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computer 108. Subsequently, a model of the object 152 is presented on a picture 
screen 155 linked to the second computer 108 upon employment of the decoded 
image information of the object 152. 

The second computer 108 has the same structure as the first computer 101. 
5 The second computer 108 also comprises a processor 109, [said] tfie processor 
being coupled to a memory 110 with a bus 111. 

The method described below for the image decoding is realized in 
software. It is stored in the memory 110 and is implemented by the processor 
109. 

1 0 Figure 2 schematically shows the procedure for a processing of a 

digitalized image in the framework of an encoding and of a decoding with a 
registration of an object with a camera and a presentation of the object on a 
picture screen. 

This procedure for the encoding and the decoding is realized by the 
1 5 arrangement shown in Figure 1 and described above. 

1^* Step Registration of the Object (201) 

Upon employment of the camera 101 as described in [p^] the pubhcation 
by W, Niem et al., "Mapping texture from multiple Camera Views onto 3D 
Obiect Models for Computer Animation". Proc. of Mtemational Wo rkshop on 
2 0 Stereoscopic and Three Dimensional Imaging , images of the object 1 52 are 

registered, said object 152 being rotated in its position relative to the camera 101 
in predetermined rotational angles with the object carrier 153. The images are 
transmitted to the first computer 102 in analog form. 

Before the implementation of the registration of the object 152, the camera 
2 5 101 is calibrated, as described in the pubhcation bv W. N iem et al., 

"Mapping texture from multiple Camera Views onto 3D Object Models for 
Computer Animation'', Proc. of Intemational Workshop on Stereos copic and 
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Three Dimensional Imaging , whereby a spatial geometry of the arrangement as 
well as the exposure parameters of the camera 101, for example the focal length 
of the camera 101, are defined. 

The geometry data as well as the camera parameters are transmitted to the 
5 first computer 102. 

2. Digitalizing the Images (202) 

The analog images are converted into digitalized images in the first 
computer 102 and the digitalized images are processed. 
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3. Image Processing (203) 

The processing of the digitaUzed images 103 ensues according to the 
method of automatic three-dimensional modeling upon employment of a plurality 
of images of the object, as described in [f?}] the pubUcation bv W. N iem et al.. 
5 "Mapping texture from multiple Camera Views onto 3D Object Models for 
Computer Animation''. Proc. of hitemational Workshop on Stereosc opic and 
Three Dimensional hnaging . 

Two method steps are implemented in the framework of the method of 
automatic three-dimensional modeling upon employment of a plurahty of images 
10 of an object: 

In the first step of the method, a volume model 301 of the object 152 is 
determined with a method for determining a contour of an object in a digitalized 
image, as cited in [fffj] the publication bv W. Niem et ah, "M apping texture from 
multiple Camera Views onto 3D Object Models for Computer Animation", Proc. 
1 5 of Intemational Workshop on Stereoscopic and Three Di mensional Imaging, upon 
employment of the camera parameters and of the digitalized images 103. 

The volume model 301 of the object 152, as shown in Figure 3, is 
composed of a spatial, triangular grid structure 301, whereby the comer points 
302 of the triangles 303 are present as points 304 of a Cartesian coordinate system 
2 0 305. 

In the second step of the method, what is referred to as a structure map 
306 is determined for each triangle 303 upon employment of the digitalized 
images 103 as well as of the color information contained in picture elements of 
the digitalized images 103. 
2 5 The structure map is constructed of picture elements 307 arranged block- 

like. Each picture element 307 contains a color information (chrominance values) 

of the object 152. 

The color information is allocated to the triangle 303 in that an 
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appertaining picture element 307 of the appertaining structure map 306 is 
respectively allocated to a comer point 302 and 308 of the triangle 303 and 309. 

The position of the comer points 308 of the triangle 309 is determined by 
the specification of coordinates (u^, Vj) 310 in a two-dimensional coordinate 
5 system (u, v) 3 1 1 that is allocated to the stracture map 306. The coordinates {n,, 
Vj) 310 are subsequently normed. 

Via a transformation mle, the corresponding point 310 in the appertaining 
stmcture map 306 is assigned to each comer point 302 of each triangle 303 of the 
three-dimensional model 301. 
1 0 Those picture elements 501 of a stmcture map that contain a color 

information relevant for the presentation of the object 152 are transformed into a 
new triangular stmcture map 503. The picture elements 506 of the triangular 
stmcture map are arranged such that they form a right-angle and equilateral 
triangle, whereby one side comprises five picture elements. The transformation is 
1 5 implemented such that the picture elements 501 that are comer picture elements 
504 of the triangle 505 coincide with picture elements 506 that are comer picture 
elements 507 of the triangular stmcttire map 503. 

In the framework of the transformation, picture elements may potentially 
have to be generated by an extrapolation or an interpolation of values that contain 
2 0 color information or picture elements may potentially have to be deleted. 

The triangular stmcture map 503 thus comprises only picture elements 506 
that are relevant for the presentation of an object. 

As shown in Figure 6, all triaagular stracture maps 601 that contain the 
color information relevant for the presentation of the object are arranged to 
2 5 [f]fonn[fl a new superstmcture map 602. 

To that end, respectively two triangular stmcture maps 601 are arranged to 
[f]form[}] a block-shaped stracture map 603. Further, all block-shaped stracture 
maps 603 are groups by rows and columns, whereby a digitalized image is 
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generated. 

Due to the uniform and predetermined shape of the triangular structure 
map, the row-by-row and column-by-column arrangement of the block-shaped 
structure maps 603 and a predetermined size of the superstructure map 602, a 
5 simplified transformation rule or, respectively, a simpUfied allocation key derives 
that is referred to as texture binding: 

Each triangle 303 of the spatial triangular grid structure 301 of the three- 
dimensional model of the object 152 has allocated to it a first value that 
indicates the coluran number of the triangular structure map 601 belonging to the 

1 0 triangle 303 within the superstructure map 602, a second value that indicates 
the row number of the triangular structure map 601 belonging to the triangle 303 
within the superstructure map 602, and a third value % that indicates the relative 
position of the triangular structure map 601a or, respectively, 601b with respect to 
the block-shaped structure map 603. 

1 5 Upon employment of the value triad (ns, %, nj indicated for each triangle 

303 of the spatial grid structure 301 and of the given values in view of the height 
H (plurality of picture elements, for example 80 picture elements) of the 
superstructure map having the size HxB and of the given plurahty of picture 
elements Z arranged in a side of the right equilateral triangle with, for example, 

2 0 Z=5 picture elements, an allocation of a triangular structure map 601 of the 

superstructure map 602 to the appertaining triangle 303 of the volume model 301 
of the object is determined according to the following relationships: 
A,-(Z/B)*(ns-1) 
Ay -(Z/H) *(%-!) 

25 B,-(Z/B)*ns 

C, = (Z/H)*nz 



-54- 



The comer picture elements (Ax,Ay). (Cx,Cy) and (Dx,Dy) are relevant 
for the value nL = 0 that describes a triangular structure map 601a arranged at the 
5 left within the block-shaped structure map 603. 

The comer points (A^,Ay), C^,Cy) and (8^3^) are relevant for the value 
= 1 that describes a triangular stracture map 601b arranged at the left within the 
block-shaped structure map 603. 

The two values that are identified by the index x and by the index y 
1 0 thereby indicate the coordinates of a point of the superstructure map 602 with 
respect to a Cartesian coordinate system 610 that is arranged in the upper left 
comer 611 of the superstructure map 602, 



4. Encoding (204) 

What is referred to as a Triangle-Adaptive Discrete Cosine Transformation 
1 5 [ (SA-DCT) [sic] ] fTA-DCT) is employed for the encoding of the superstructure 

map 602. This method for encoding a digitalized image is based on the method of 
a Shape- Adaptive Discrete Cosine Transformation (SA-DCT) as described in 
[f4f] the publication bv T. Sikora et aL, ^^Shape Adaptive DCT for Generic 
Codine of Video'', IEEE Transactions on Circuits and Svstems for Video 
2 0 Technology . 

In the fi-amework of a TA-DCT, the transformation coefficients allocated 
to an image object are defined such that picture elements of an edge image block 
that do nor belong to the image object are blanked out. A one-dimensional DCT, 
whose length corresponds to the number of picture elements remaining in the 
2 5 respective column, is then first appUed column-by-column to the remaining 
picture elements. The resulting transformation coefficients are subsequently 
subjected to a fiirther one-dimensional DCT in horizontal direction with a 
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corresponding length. 

The method of TA-DCT proceeds from a transformation matrix DCT-N 
having the following structure: 



withp, k = 0-N-l. 

N references a quantity of the image vector to be transformed wherein the 
transformed picture elements are contained. 

DCT-N references a transformation matrix having the size NxN. 

p, k reference indices with p, k e [0, N-1]. 

After the TA-DCT, each column of the image block to be transformed is 
vertically transformed according to the rule 



Subsequently, the same rule is appHed to the resultant data in horizontal direction. 

hi the framework of the encoding of a superstructure map 602 upon 
employment of TA-DCT, the superstructure map 62 is subdivided into the block- 
shaped structure maps 603. A block-shaped structure map 603 and 901 is thereby 
divided into a first new block-shaped structure map 902 and a second new block- 
shaped structvtre map 903, as shown in Figure 9, in that the picture elements of the 
second triangular structure map 601b and 904 are deleted for the determination of 
the first new block-shaped structure map 602. The second new block-shaped 
structure map 903 is determined in that the picture elements of the first triangular 
structure map 601a and 905 are deleted. 

Further, the second new block-shaped structure map 903 is modified such 




(1) 
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by shifting picture elements 906 that the relative position of the picture elements 
906 of the second block-shaped structure map 903 with respect to the second new 
block-shaped structure map 903 coincides with the relative position of the picture 
elements 907 of the first new block-shaped structure map 902 with respect to the 
5 first new block-shaped structure map 902. 

The TA-DCT can thus be correspondingly apphed to the first new block- 
shaped structure map 902 and to the second new block-shaped structure map 903. 

The TA-DCT can be utihzed due to the specific relative position of the 
picture elements 906 and 907 with respect to the first new block-shaped structure 
1 0 map 902 and the second new block-shaped structure map 903 . 



5. Transmission (205) 

The image information (image information of the superstructure map) 
encoded upon employment of the TA-DCT is transmitted via a transmission 
medium 107 to the second computer 108 together with data of the volume model 
15 of the object as well as of the allocation (n^, nj^ (i = 1 ... N, with N = number 
of triangles of the grid structure of the volume model). 



6. Decoding (206) 

An image decoding is implemented after transmission of the encoded 
image information. 

2 0 To that end, the spectral coefficients Cj are supplied to an inverse TA- 

DCT. 

Given inverse TA-DCT in the framework if image encoding in the intra- 
image encoding mode, picture elements Xj are formed from the spectral 
coefficients Cj according to the following rule (4): 
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Xj = .\^*{DCT-J^{p,k)Y'*c^ 



(4) 



whereby the transformation matrix DCT-N comprises the following structure: 



DCT- N(p,k) = r*cos 



(1) 



10 



withp,k-0->N-L 
whereby 

- N references a size of the image vector to be transformed wherein the picture 
elements to be transformed are contained; 

- [ DCT-N (p, k)] references a transformation matrix having the size NxN; 

- p, k reference indices with p, k e [0, N-1]; 
~ ( references an inversion of a matrix. 

The decoded image or, respectively, the superstructure map 602 is 
determined upon employment of the determined picture elements Xj. 



7. Presentation of the Object (207) 

The model of the object 152 is presented on the picture screen 108 upon 
1 5 employment of the superstructure map, the data of the volume model of the object 
152 as well as the allocation(ns, n^, n^), (i = 1 ... N, with N = number of triangles 
of the grid structure of the volume model), as described in [f6J] the Internet 
pubhcation PANORAMA technical Support, available on 12 October 1998 at: 
http ://vvww.tnt .uni-hannover.de/proi ect/eu/panorama/TS .html. 
2 0 Although other modifications and changes may be suggested bv those 

skilled in the art, it is the intention of the inventors to embody within the patent 
warranted hereon all changes and modijScations as reasonably and properly come 
within the scone of their contribution to the art. 
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[ Pateut: Claims ] I claim: 

1. (Amended) A method [ Method ] for processing a digitahzed image with 
picture elements that contain an encoding information, comprising the steps of: 

[a) whereby ] 

dividing the image is at least partially [ divided ] into image blocks; 

[b) whereby ] 

subdividing an appertaining image block [is] respectively [ subdivided ] into at 

least two appertaining image sub-blocks; 
[ chai - actcrizcd in that the ] 

implementing processing of the image [ is implemented ] such that a first value and 
[,] a second value and a third value are respectively allocated to at least 
one image sub-block, [ whereby ] the first value and the second value 
describe the relative position of the appertaining image block with respect 
to the image and the third value describes the relative position of the 
appertaining image sub-block with respect to the appertaining image 
block. 

2. (Amended) A method [Method] according to claim 1, wherein said step 
of subdivid ing provides that [ whereby ] the appertaining image block is 
subdivided into a plurality of appertaining image sub-blocks. 

2 0 3. (Amended) A method [Method] according to claim 1 [or^], wherein 

said step of implementing provides that [whereby] the first value and [,] the 
second value and the third value are respectively allocated to each appertaining 
image sub-block. 

4. (Amended) A method [Method] according to claim [one of the claims] 
2 5 L wherein [through 3, whereby] the image blocks are arranged in columns and 
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rows [and/or column numbers are assigned to the columns and row numbers are 
assigned to the rows]. 

5. (Amended) A method [Method] according to claim 29 [4], wherein a 
[whereby the] first value of the appertaining image sub-block is the row number 
of the appertaining image block and a [the] second value of the appertaining 
image sub-block is the column number of the appertaining image block. 

6. (Amended) A method [Method] according to claim [one of the claims] 
1 [through 5], wherein [whereby] the appertaining image sub-blocks exhibit a 
different shape than the appertaining image block. 

7. (Amended) A method [Method] according to claim [one of the claims] 
L wherein [through 6, whereby] the image sub-blocks are of [comprise] a 
triangular shape. 

8. (Amended) A method [Method] according to claim 7, wherein 
[whereby] the triangular shape includes [comprises] a right angle. 

9. (Amended) A method [Method] according to claim [one of the claims] 
1 [through 8], further comprising the step of: [whereby] 

modifying the appertaining image sub-blocks [are modified] such that the 

respective position of an appertaining image sub-block with respect to the 
appertaining image block is respectively identical. 

10. (Amended) A method [Method] according to claim [one of the claims] 
1 , further comprising the step of: 

utilizing the steps for [through 9 utihzed in the framework of an] encoding of the 
image. 



11. (Amended) A method [Method] according to claim 10, further 
comprising the steps of: [whereby] 

encoding the image sub-blocks [are encoded] upon employment of the encoding 
information [and/or upon employment of the first value, the second value 
and the third value] with a shape-adaptive transformation encoding. 

12. (Amended) A method [Method] according to claim 11, wherein 
[whereby] a shape-adaptive Discrete Cosine Transformation [ (DCT) ] is utilized 
for the encoding. 

13. (Amended) A method [Method] according to claim 12, wherein 
[whereby] a Shape- Adaptive Discrete Cosine Transformation [(SA-DCT)] is 
utilized for the encoding, 

14. (Amended) A method [Method] according to claim 13, wherein 
[whereby] a Triangle- Adaptive Discrete Cosine Transformation [(TA-DCT)] is 
utilized for the encoding. 

15. (Amended) A method [Method] according to claim [one of the claims] 
L wherein the steps are [through 9] utilized in the framework of a decoding of the 
image. 

16. (Amended) A method [Method] according to claim 15, wherein 
[whereby] an inverse shape-adaptive Discrete Cosine Transformation [(DCT)] is 
utilized for the decoding. 

17. (Amended) A method [Method] according to claim 16, wherein 
[whereby] an inverse Shape- Adaptive Discrete Cosine Transformation [(SA- 



DCT)] is utilized for the decoding. 



18. (Amended) A method [Method] according to claim 17, wherein 
[whereby] an inverse Triangle- Adaptive Discrete Cosine Transformation [(TA- 
DCT)] is utihzed for the decoding. 

19. (Amended) A method [Method] according to claim [one of the claims] 
1 , wherein [through 18, whereby] the image at least partly includes [comprises] 
triangular structure maps. 

20. (Amended) An arrangement [Arrangement] for processing a 
digitalized image with picture elements that contain an encoding information, 
comprising: [whereby] 

a processor [is provided] that is configured such that the following method steps 
can be implemented: 

[a) ] the image is at least partially divided into image blocks; 

[b) ] an appertaining image block is respectively subdivided into at least two 

appertaining image sub-blocks; 
[characterized in that] the processing of the image is implemented such that a first 
value and [J a second value and a third value are respectively allocated to at least 
one image sub-block, [whereby] the first value and the second value describe the 
relative position of the appertaining image block with respect to the image and the 
third value describes the relative position of the appertaining image sub-block 
with respect to the appertaining image block. 

21. (Amended) An arrangement [Arrangement] according to claim 20, 
wherein [whereby] the appertaining image block is [can be] subdivided into a 
plurality of appertaining image sub-blocks. 



22. (Amended) An arrangement [Arrangement] according to claim 20 [or 
21], wherein [whereby] the respective first value and the respective second value 
and the respective third value are [can be] allocated to each appertaining image 
sub-block. 

23. (Amended) An arrangement [Arrangement] according to claim [one of 
the claims] 20 . wherein the processor is [through 22 that can be] utilized in [the 
framework of] an encoding of the image. 

24. (Amended) An arrangement [Arrangement] according to claim 23, 
wherein [whereby] a shape-adaptive Discrete Cosine Transformation is [(DCT) 
can be] utilized for the encoding. 

25. (Amended) An arrangement [Arrangement] according to claim 24, 
wherein [whereby] an inverse Triangle- Adaptive Discrete Cosine Transformation 
is [(TA-DCT) can be] utilized for the encoding. 

26. (Amended) An arrangement [Arrangement] according to claim [one of 
the claims] 20 . wherein the processor is [through 25 that can be] utilized in the 
framework of a decoding of the image. 

27. (Amended) An arrangement [Arrangement] according to claim 26, 
wherein [whereby] an inverse shape-adaptive Discrete Cosine Transformation is 
[(DCT) can be] utiUzed for the decoding. 

28. (Amended) An arrangement [Arrangement] according to claim 27, 
wherein [whereby] an inverse Triangle- Adaptive Discrete Cosine Transformation 
is [(TA-DCT) can be] utilized for the decoding. 
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29. A method according to claim L further compri sing the step of: 
assigning colunm numbers to the colunms and row numb ers to the rows. 

30. A method according to claim 10, further comprising the steps of: 
encoding the image sub-blocks upon employmen t of the first value and the second 

value and the third value with a shape-adaptive tr ansformation encoding. 
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Abstract of the Disclosure 

[METHOD AND ARRANGEMENT FOR PROCESSING A DIGIT ALIZED 
IMAGE] 

Methods and arrangements are recited for processing a digitahzed image 
5 with picture elements that contain an encoding information. To that end, the 

image is divided into image blocks and a respective image block is divided into 
two image sub-blocks. The processing of the image is implemented such that a 
respective first value and a respective second value and a respective third value is 
allocated to an image sub-block, whereby the first value and the second value 

1 0 describe the relative position of the appertaining image block with respect to the 
image and the third value describes the relative position of the appertaining image 
sub-block with respect to the appertaining image block. Further, the employment 
of the method and of the arrangement in the framework of an encoding and 
decoding is recited, 

15 [Figure 2] 
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METHOD AND ARRANGEMENT FOR PROCESSING A DIGITALIZED 



IMAGE 



The invention is directed to an arrangement and to a method for 
processing a digitalized image as utihzed and implemented in the framework of an 
5 encoding and decoding of a digitaUzed image. 

Such a method and such an arrangement are utihzed in the framework of 
an encoding and decoding of a digitahzed image corresponding to one of the image 
encoding standards H.261 [1], H.263 [2] of MPEG2 [3] that are based on the principle 
of a block-based image encoding. According to [3], the method of a block-based 
1 0 discrete cosine transformation (DCT) is employed for block-based image encoding. 

Another approach for processing a digitalized image corresponding to the 
image encoding standard MPEG4 is what is referred to as the principle of object- 
based image encoding, as known from [3]. 

In object-based image encoding, a segmentation of an image master into 
15 image blocks ensues corresponding to objects occurring in a scene, and a separate 
encoding of these objects ensues. 

Components of a standard arrangement for an image encoding, as also 
known from [7], and of an image decoding can be derived from Figure 7. 

Figure 7 shows a camera 701 with which images are registered. The 
2 0 camera 701 can, for example, be an arbitrary analog camera 701 that registers images 
of a scene and either digitalizes the images in the camera 701 and transmits the 
digitalized images to a first computer 702 that is coupled to the camera 701 or 
transmits the images to the first computer 702 in analog form as well. In the first 
computer 702, the analog images are converted into digitalized images and the 
2 5 digitalized images are processed. 

The camera 701 can also be a digital camera 701 with which directly 
digitalized images are registered and supplied to the first computer 702 for further 
processing. 



The first computer 702 can also be designed as an autonomous 
arrangement with which the method steps described below are implemented, for 
example as an autonomous computer card that is installed in a further computer. 

What is to be generally understood by the first computer 702 is a unit that 
can implement an image signal processing according to the method described below, 
for example a mobile terminal device (mobile telephone with a picture screen). 

The first computer 702 comprises a processor umt 704 with which the 
method steps of the image encoding and image decoding described below are 
implemented. The processor unit 704, for example, is coupled via a bus 705 to a 
memory 706 in which an image information is stored. 

In general, the methods described below can be reahzed both in software 
as well as in hardware or partly in software and partly in hardware. 

After the image encoding has ensued in the first computer 701 and after 
the transmission of the encoded image information via a transmission medium 707 to 
a second computer 708, the image decoding is implemented in the second computer 
708. 

The second computer 708 can have the same structure as the first 
computer 701. The second computer 708 thus also comprises a processor 709 that is 
coupled to a memory 710 by a bus 711. 

Figure 8 shows a possible arrangement in the form of a schematic diagram 
of the image encoding or, respectively, image decoding. The illustrated arrangement 
can be employed within the framework of a block-based image encoding and - also 
shall be explained in greater detail later - can be employed in part within the 
framework of an object-based image encoding. 

In the block-based image encoding, a digitalized image 801 is divided into 
what are usually quadratic image blocks 820 having a size of 8x8 picture elements 
802 or 16x16 picture elements 802 and is supphed to the arrangement 803 for image 
encoding. 

Coding information, for example brightness information (luminance 
values) and/or color information (chrominance values), is usually allocated to a 
picture element 802. 
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In block-based image encoding, a distinction is made between different 
image encoding modes. 

In what is referred to as intra-image encoding, the digitahzed image 801 is 
respectively encoded with the coding information allocated to the picture elements 
5 802 of the digitahzed image and is transmitted. 

In what is referred to as an inter-image encoding, only a difference image 
information of two chronologically successive, digitahzed images 801 is respectively 
encoded and transmitted. 

The difference information is very small when movements of image 
1 0 objects are slight in the chronologically successive, digitahzed images 801 . When the 
movements are great, then a great deal of difference information arises that is difficult 
to encode. For this reason and as known from [3], an ''image-to-image" movement 
(motion estimate) is measured and compensated before the determination of the 
difference information (motion compensation). 
1 5 There are different methods for the motion estimation and the motion 

compensation as known from [3]. What is referred to as a "block matching method" 
is usually utilized for the block-based image encoding. It is based thereon that an 
image block to be encoded is compared to reference image blocks of the same size in 
a reference image. The sum of the absolute differences of an encoding information 
2 0 that is respectively allocated to a picture element is usually employed as criterion for a 
comcidence quality between the block to be encoded and a respective reference image 
block. In this way, a motion information for the image block is determined, for 
example a motion vector, this being transmitted with the difference information. 

Two switch units 804 are provided for switching between the intra-image 

2 5 encoding and the inter-image encoding. A subtraction unit 805 wherein the difference 

of the image information of two chronologically successive, digitahzed images 801 is 
formed is provided for the implementation of the inter-image encoding. The image 
encoding is controlled via an image encoding control unit 806. The image blocks 820 
to be encoded or, respectively, difference image blocks are respectively supphed to a 

3 0 transformation encoding unit 807. The transformation encoding unit 807 applies a 



transformation encoding, for example a discrete cosine transformation (DCT), to the 
encoding information allocated to the picture elements 802. 

In general, however, any desired transformation encoding, for example a 
discrete sine transformation or a discrete Fourier transformation, can be applied for 

the image encoding. 

Spectral coefficients (transformation coefficients) are formed by the 
transformation encoding. The spectral coefficients are quantized in a quantization 
unit 808 and are supplied to an image encoding multiplexer 821, for example to a 
channel encoding and/or to an entropy encoding. The quantized spectral coefficients 
are inversely quantized in an inverse quantization unit 809 and are subjected to an 
inverse transformation encoding in an inverse transformation encoding unit 810. 

In the case of inter-image encoding, further, image information of the 
respective, chronologically preceding image are added in an adder unit 811. The 
images reconstructed in this way are stored in a memory 812. For simpler 
presentation, a unit relating to the motion compensation 813 is symbolically presented 

in the memory 812. 

Further, a loop filter 814 is provided that is connected to the memory 812 

as well as to the subtraction unit 805. 

In addition to a transmitted image information 822, a mode index that 
respectively indicates whether an intra-image encoding or inter-image encoding was 
undertaken is also supphed to the image encoding multiplexer 821. 

Further, quantization indices 816 for the spectral coefficients are supplied 
to the image encoding multiplexer 821. 

A motion vector is respectively allocated to an image block 820 and/or to 
a macro block 823 that, for example, comprises four image blocks 820 and is supphed 
to the image encoding multiplexer 821 . 

Further, an information particular for the activation or, respectively, 
deactivation of the loop filter is provided. After transmission of the image 
information via a transmission medium 818, the decoding of the transmitted 
information can ensue in a second computer 819. To this end, an image decoding unit 



825 is provided in the second computer 819, this unit 825, for example, comprising 
the structure of a reconstruction loop of the arrangement shown in Figure 8. 

[4] discloses a shape-adapted transformation encoding is specifically 
applied in the framework of an object-based image encoding to edge image block or 
5 image blocks that contain only partially relevant encoding information. The edge 
image blocks encoded upon employment of a shape-adapted transformation encoding 
are characterized in that only the picture elements that are allocated to an object or, 
respectively, that comprise encoding information relevant to the object are encoded. 
The method described in [4] is what is referred to as a shape-adapted 
1 0 Discrete Cosine Transformation (Shape-Adaptive DCT, S A-DCT). 

Within the framework of an S A-DCT, the transformation coefficients 
allocated to an image object are defined such that picture elements of an edge image 
block that do not belong to the image object are blanked out. A one-dimensional 
DCT is then initially applied to the remaining picture elements column-by-column, 
1 5 the length thereof corresponding to the number of remaining picture elements in the 
respective column. The resulting transformation coefficients are horizontally aligned 
are a subsequently subject in [sic] a further one-dimensional DCT in horizontal 
direction with corresponding length. 

The rule of S A-DCT known fi-om [4] proceeds fi-om a transformation 
2 0 matrix DCT-N having the following structure: 

^ 1^ 



DCT- N(p,k) = 7* cos 



V 2J N 



71 

* — 



(1) 



withp,k = 0->N-l. 

N references a quantity of the image vector to be transformed wherein the 

transformed picture elements are contained, 
2 5 DCT-N references a transformation matrix having the size NxN. 

p, k reference indices with p, k e [0, N-1]. 

After the S A-DCT, each column of the image block to be transformed is 
vertically transformed according to the rule 
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S = n PCT- N {p,k)rx, (2) 

Subsequently, the same rule is applied to the resultant data in horizontal direction. 
Various methods for the presentation of an object on a picture screen are 

employed in computer graphics. One method for the presentation of a subject is what 
5 is referred to as texture mapping. 

[5] discloses such a texture mapping. 

In the framework of texture mapping, a digital image that contains a 
brightness information (luminance values) and/or a color information (chrominance 
values) of the object to be presented is mapped onto a surface of a three-dimensional 

1 0 model of an object to be presented. 

The three-dimensional model 301 of the object to be presented, said model 
301 being shown in Figure 3, is composed of a spatial, triangular grid structure 301, 
whereby the comer points 302 of the triangles 303 are present as points 304 of a 
Cartesian coordinate system 305. 

15 As shown in Figure 3, what is referred to as a block-shaped structxxre map 

306 is allocated to each triangle 303, as shown in Figure 3, said map 306 being 
constructed of picture elements 307 that are arranged rectangularly or, respectively, 
block-like. A brightness information (luminance values) and/or a color information 
(chrominance values) is usually allocated to each picture element 307. 

2 0 The brightness or color information is allocated to the triangle 303 such 

that an appertaining picture element 307 of the appertaining structure map 306 is 
respectively allocated to a comer point 302 and 308 of the triangle 303 and 309. 

The position of a comer point 308 of the triangle 309 is defined by the 
indication of coordinates (u^, v,) 310 in a two-dimensional coordinate system (u, v) 

2 5 311 that is assigned to the structure map 306. The coordinates (uj, Vj) 310 are usually 
normed. 
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Via a transformation rule (allocation or, respectively, allocation key), the 
corresponding point 310 in the appertaining structure map 306 is allocated to each 
comer point 302 of each triangle 303 of the three-dimensional model 301. 

As shown in Figure 4, further, all structure maps 401 are combined into a 
5 digitalized image 402, what is referred to as a superstructure map 402, wherein the 
individual structure maps 401 are arranged row-by-row and column-by-column. As 
warranted, the structure maps 401, which contain encoding information relevant for 
the presentation of the object, must be supplemented with structure maps 404 that 
contain no encoding information that is relevant for the presentation of the subject, 
10 In particular, however, the above-described method exhibits a 

disadvantage. The structure maps and the superstructure maps as well comprise 
picture elements that contain no brightness or color information relevant for the 
representation of the object. 

When the superstructure map is encoded in the framework of an image 
1 5 transmission, then the data rate occurring in the transmission is urmecessarily 
increased by the non-relevant picture elements. 

For improving the above method^ a structure map is processed in the 
following way (see Figure 5): 

Those picture elements 501 of a structure map 502 that contain picture 
2 0 elements [.,.] an encoding information relevant for the presentation of the object are 
transformed into a new triangular structure map 503 with picture elements 506 that 
are arranged in a predetermined shape — usually a right triangle - and in a 
predetermined size. The transformation is implemented such that the picture elements 
501, which are comer picture elements 504 of the triangle 505, coincide with picture 

2 5 elements 506 that are comer picture elements 507 of the triangular stmcture map. 

In the scope of the transformation, picture elements may potentially have 
to be generated by an extrapolation or an interpolation of values that contain a 
brightness or color information or picture elements may potentially have to be 
deleted. 

3 0 The triangular stmcture map 503 thus only comprises picture elements 

506 that are relevant for the presentation of an object. 
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As shown in Figure 6, all triangular structure maps 601 that contain 
brightness or color information relevant for the presentation of the object are arranged 
to form a new superstructure map 602. 

To that end, respectively two triangular structure maps 601a and 601b are 
5 arranged to form a block-shaped structure map 603. 

Further, all block-shaped structure maps 603 are grouped by rows and 
columns, a digitalized image being thus generated. 

[5] also discloses that such a superstructure map as generated in the 
framework of a texture mapping is encoded and decoded in an image transmission. 
1 0 The encoding and/or decoding of a superstructure map thereby usually 

ensues upon emplo3nnent of a block-oriented transformation in the intra-image 
encoding mode, as was set forth above. 

As implemented in the framework of a processing of a digital image, this 
procedure is not very efficient in view of a low data rate to be desired for a 
1 5 transmission or in view of a higher image quality. 

The invention is thus based on the problem of specifying a method for 
processing a digitalized image and an arrangement for processing a digitalized image 
with which a more efficient processing of a digitalized image becomes possible. 

The problem is solved by the method comprising the features according to 
2 0 the independent claims as well as by the arrangements comprising the features 
according to the independent claims. 

In the method for processing a digitalized image with picture elements that 
contain an encoding information, the image is at least partly divided into image 
blocks. Respectively one image block is subdivided into at least two appertaining 

2 5 image sub-blocks. The processing of the image is implemented such that a first value, 

a second value and a third value are respectively allocated to at least one appertaining 
image sub-block, whereby the first value and the second value describe the relative 
position of the appertaining image block with respect to the image and the third value 
describes the relative position of the appertaining image sub-block with respect to the 

3 0 appertaining image block. 
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In the arrangement for processing a digitalized image having picture 
elements that contain an encoding information, a processor is provided that is 
configured such that the following method steps can be implemented: 
The image is at least partially divided into image blocks. Respectively one image 
5 block is subdivided into at least two appertaining image sub-blocks. The processing 
of the image is implemented such that a first value, a second value and a third value 
are respectively allocated to at least one of the appertaining image sub-blocks, 
whereby the first value and the second value describe the relative position of the 
appertaining image block with respect to the image and the third value describes the 
1 0 relative position of the appertaining image sub-block with respect to the appertaining 
image block. 

Preferred developments of the invention derive fi^om the dependent claims. 

In one development, which effects a simplification of the method, the 
image blocks are arranged in rows and columns and/or column numbers are assigned 
15 to the columns and row numbers are assigned to the rows. The allocation expediently 
ensues such that the first value of the appertaining image sub-block is the row number 
of the appertaining image block and the second value of the appertaining image sub- 
block is the column number of the appertaining image block. 

In another development, an image sub-block exhibits a different shape 
2 0 than the appertaining image block. Preferably, the shape of the image sub-block is a 
triangle that has a right angle. Such a shape of an image sub-block reduces the 
calculating outlay for a shape-adaptive transformation encoding. 

The image sub-blocks are preferably combined to form the image. The 
image thus comprises only picture elements that contain encoding information 

2 5 relevant for an object. 

It is also advantageous to modify the image sub-blocks such that the 
relative position of an image sub-block is respectively identical with respect to the 
appertaining image block. A shape-adaptive transformation encoding can thus be 
applied in the fi*amework of an encoding and/or an inverse transformation encoding 

3 0 can be applied in the framework of a decoding, being applied to all image sub-blocks 

of the appertaining image block. 
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One development is utilized in the framework of an encoding and/or 
decoding of the image. 

It is thereby advantageous to encode the image sub-blocks with a shape- 
adaptive transformation encoding upon employment of the encoding information 
5 and/or upon employment of the first value, second value and third value and/or to 

decode the image sub-blocks with an inverse shape-adaptive transformation encoding. 
An efficient encoding and/or decoding of the image is thereby achieved, 

A simplification derives when, in one development, a Shape- Adaptive 
Discrete Cosine Transformation (S A-DCT) for encoding and/or an inverse SA-DCT 
1 0 for decoding is/are employed. 

A further simplification derives when a Triangle-Adaptive Discrete Cosine 
Transformation (T A-DCT) for encoding and/or an inverse TA-DCT for decoding 
is/are employed. 

An exemplary embodiment of the invention is shown in the Figures and is 
1 5 explained in greater detail below. 
Shown are: 

Figure 1 arrangement for image encoding and image decoding with a registration of 
an object with a camera and a presentation of the object on a picture 
screen; 

2 0 Figure 2 schematic illustration of the procedure for image encoding and image 

decoding with a registration of an object with a camera and a presentation 
of the object on a picture screen; 
Figure 3 triangular grid structure of a three-dimensional model with an appertaining 
structure map; 

2 5 Figure 4 illustration of a superstructure map; 

Figure 5 illustration of a transformation of a structure map onto a triangular 
structure map; 

Figure 6 illustration of a superstructure map composed of triangular structure maps; 
Figure 7 arrangement for image encoding or, respectively, image decoding with a 

3 0 camera, two computers and a transmission medium; 
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Figure 8 sketch of an arrangement for block-based image encoding or, respectively, 
image decoding; 

Figure 9 illustration of the resolution of the block-shaped structure map. 

Figure 1 shows an arrangement for an image encoding and an image 
5 decoding with a registration of an object with a camera and a presentation of the 
object on a picture screen. 

Figure 1 shows a camera 101 with which images of an object 152 are 
registered. The camera 101 is an analog color camera that registers images of the 
object 152 and transmits the images to a first computer 102 in analog form, in the 
10 first computer 102, the analog images are converted into digitalized images, whereby 
picture elements of the digitalized images contain a color information of the object 
152, and the digitahzed images are processed. 

The object 152 is arranged centered on an object carrier 153. The relative 
position of the object carrier 153 with respect to the camera 101 is permanently 
15 prescribed. By rotating the object carrier 153 around its center, the object 152 can be 
moved such that the angle of view from which the camera 101 registers the object 152 
changes continuously given an unmodified distance of the object 152 fi*om the camera 
101. 

The first computer 102 is configured as an autonomous arrangement in the 
2 0 form of an autonomous computer card that is installed in the first computer 102, the 
method steps described below being implemented with said computer card. 

The first computer 102 comprises a processor 104 with which the method 
steps of image encoding described below are implemented. The processor unit 104 is 
coupled via a bus 105 to a memory 106 in which an image information is stored. 

2 5 The method for image encoding described below is realized in software. 

It is stored in the memory 106 and is implemented by the processor 104. 

After the image encoding has ensued in the first computer 101 and after a 
transmission of the encoded image information via a transmission medium 107 to a 
second computer 108, the image decoding is implemented in the second computer 

3 0 108. Subsequently, a model of the object 152 is presented on a picture screen 155 
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linked to the second computer 108 upon employment of the decoded image 
information of the object 152. 

The second computer 108 has the same structure as the first computer lOL 
The second computer 108 also comprises a processor 109, said processor being 
5 coupled to a memory 110 with a bus 111. 

The method described below for the image decoding is realized in 
software. It is stored in the memory 110 and is implemented by the processor 109. 

Figure 2 schematically shows the procedure for a processing of a 
digitalized image in the framework of an encoding and of a decoding with a 
1 0 registration of an object with a camera and a presentation of the object on a picture 
screen. 

This procedure for the encoding and the decoding is realized by the 
an'angement shown in Figure 1 and described above. 

1'' Step Registration of the Object (201) 

15 Upon employment of the camera 101 as described in [7], images of the 

object 152 are registered, said object 152 being rotated in its position relative to the 
camera 101 in predetermined rotational angles with the object carrier 153. The 
images are transmitted to the first computer 102 in analog form. 

Before the implementation of the registration of the object 152, the camera 

2 0 1 01 is calibrated, as described in [7], whereby a spatial geometry of the arrangement 
as well as the exposure parameters of the camera 101, for example the focal length of 
the camera 101, are defined. 

The geometry data as well as the camera parameters are transmitted to the 
first computer 102. 



25 



2. Digitalizing the Images (202) 

The analog images are converted into digitalized images in the first 
computer 102 and the digitalized images are processed. 
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3. Image Processing (203) 

The processing of the digitahzed images 103 ensues according to the 
method of automatic three-dimensional modehng upon employment of a plurality of 
images of the object, as described in [7]. 
5 Two method steps are implemented in the framework of the method of 

automatic three-dimensional modeling upon employment of a plurahty of images of 
an object: 

In the first step of the method, a volume model 301 of the object 152 is 
determined with a method for determining a contour of an object in a digitalized 

10 image, as cited in [7], upon employment of the camera parameters and of the 
digitalized images 103. 

The volume model 301 of the object 152, as shown in Figure 3, is 
composed of a spatial, triangular grid structure 301, whereby the comer points 302 of 
the triangles 303 are present as points 304 of a Cartesian coordinate system 305. 

15 In the second step of the method, what is referred to as a structure map 

306 is determined for each triangle 303 upon emplo3anent of the digitalized images 
103 as well as of the color information contained in picture elements of the digitalized 
images 103. 

The structure map is constructed of picture elements 307 arranged block- 
2 0 like. Each picture element 307 contains a color information (chrominance values) of 
the object 152. 

The color information is allocated the triangle 303 in that an appertaining 
picture element 307 of the appertaining structure map 306 is respectively allocated to 
a comer point 302 and 308 of the triangle 303 and 309. 

2 5 The position of the comer points 308 of the triangle 309 is determined by 

the specification of coordinates (u^, Vj) 310 in a two-dimensional coordinate system (u, 
v) 31 1 that is allocated to the structure map 306. The coordinates (Uj, v-) 310 are 
subsequently normed. 

Via a transformation mle, the corresponding point 3 10 in the appertaining 

3 0 stmcture map 306 is assigned to each comer point 302 of each triangle 303 of the 

three-dimensional model 301. 
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Those picture elements 501 of a structure map that contain a color 
information relevant for the presentation of the object 152 are transformed into a new 
triangular structure map 503. The picture elements 506 of the triangular structure 
map are arranged such that they form a right-angle and equilateral triangle, whereby 
5 one side comprises five picture elements. The transformation is implemented such 
that the picture elements 501 that are comer picture elements 504 of the triangle 505 
coincide with picture elements 506 that are comer picture elements 507 of the 
triangular structure map 503. 

In the framework of the transformation, picture elements may potentially 
1 0 have to be generated by an extrapolation or an interpolation of values that contain 
color information or picture elements may potentially have to be deleted. 

The triangular stmcture map 503 thus comprises only picture elements 
506 that are relevant for the presentation of an object. 

As shown in Figure 6, all triangular stmcture maps 601 that contain the 
15 color information relevant for the presentation of the object are arranged to [form] a 
new superstmcture map 602. 

To that end, respectively two triangular stmcture maps 601 are arranged to 
[form] a block-shaped stmcture map 603. Further, all block- shaped stmcture maps 
603 are groups by rows and columns, whereby a digitalized image is generated. 
2 0 Due to the uniform and predetermined shape of the triangular stmcture 

map, the row-by-row and column-by-colimm arrangement of the block-shaped 
stmcture maps 603 and a predetermined size of the superstmcture map 602, a 
simplified transformation mle or, respectively, a simplified allocation key derives that 
is referred to as texture binding: 

2 5 Each triangle 303 of the spatial triangular grid stmcture 301 of the three- 

dimensional model of the object 152 has allocated to it a first value that indicates 
the column number of the triangular stmcture map 601 belonging to the triangle 303 
within the superstmcture map 602, a second value % that indicates the row number of 
the triangular stmcture map 601 belonging to the triangle 303 within the 

3 0 superstmcture map 602, and a third value that indicates the relative position of the 
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triangular structure map 601a or, respectively, 601b with respect to the block-shaped 
structure map 603. 

Upon employment of the value triad (n^, n^;, n^) indicated for each triangle 
303 of the spatial grid structure 301 and of the given values in view of the height H 
5 (plurality of picture elements, for example 80 picture elements) of the superstructure 
map having the size HxB and of the given plurality of picture elements Z arranged in 
a side of the right equilateral triangle with, for example, Z=5 picture elements, an 
allocation of a triangular structure map 601 of the superstructure map 602 to the 
appertaining triangle 303 of the volume model 301 of the object is determined 
1 0 according to the following relationships: 
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The comer picture elements (Ax,Ay), (Cx,Cy) and (Dx,Dy) are relevant 
2 0 for the value nL = 0 that describes a triangular structure map 601a arranged at the left 

within the block-shaped structure map 603. 

The comer points (A^,Ay), C^,Cy) and (B^,By) are relevant for the value % 

= 1 that describes a triangular stmcture map 601b arranged at the left within the 

block-shaped structure map 603. 
2 5 The two values that are identified by the index x and by the index y 

thereby indicate the coordinates of a point of the superstructure map 602 with respect 

to a Cartesian coordinate system 610 that is arranged in the upper left comer 61 1 of 

the superstructure map 602. 



4. Encoding (204) 
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What is referred to as a Triangle- Adaptive Discrete Cosine Transformation 
(SA-DCT) [sic] is employed for the encoding of the superstructure map 602, This 
method for encoding a digitalized image is based on the method of a Shape- Adaptive 
Discrete Cosine Transformation (SA-DCT) as described in [4]. 
5 In the framevv^ork of a TA-DCT, the transformation coefficients allocated 

to an image object are defined such that picture elements of an edge image block that 
do nor belong to the image object are blanked out. A one-dimensional DCT, whose 
length corresponds to the number of picture elements remaining in the respective 
column, is then first applied column-by-column to the remaining picture elements. 
1 0 The resulting transformation coefficients are subsequently subjected to a further one- 
dimensional DCT in horizontal direction with a corresponding length. 

The method of TA-DCT proceeds fi-om a transformation matrix DCT-N 
having the following structure: 

DCT' N(p,k) = / *cos 

15 withp, k = 0-N-L 

N references a quantity of the image vector to be transformed wherein the 
transformed picture elements are contained. 

DCT-N references a transformation matrix having the size NxN. 
p, k reference indices with p, k e [0, N-1]. 
2 0 After the TA-DCT, each column of the image block to be transformed is 

vertically transformed according to the rule 

^[ DCT- N (p,k)]^x^ (2) 

Subsequently, the same rule is applied to the resultant data in horizontal direction. 
In the framework of the encoding of a superstructure map 602 upon 
2 5 employment of TA-DCT, the superstructure map 62 is subdivided into the block- 
shaped structure maps 603. A block-shaped structure map 603 and 901 is thereby 



(1) 
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divided into a first new block-shaped structure map 902 and a second new block- 
shaped structure map 903, as shown in Figure 9, in that the picture elements of the 
second triangular structure map 601b and 904 are deleted for the determination of the 
first new block-shaped structure map 602. The second new block-shaped structure 
map 903 is determined in that the picture elements of the first triangular structure map 
601a and 905 are deleted. 

Further, the second new block-shaped structure map 903 is modified such 
by shifting picture elements 906 that the relative position of the picture elements 906 
of the second block-shaped structure map 903 with respect to the second new block- 
shaped structure map 903 coincides with the relative position of the picture elements 
907 of the first new block-shaped structure map 902 with respect to the first new 
block-shaped structure map 902. 

The TA-DCT can thus be correspondingly applied to the first new block- 
shaped structure map 902 and to the second new block-shaped structure map 903. 

The TA-DCT can be utilized due to the specific relative position of the 
picture elements 906 and 907 with respect to the first new block-shaped structure map 
902 and the second new block-shaped structure map 903 . 

5. Transmission (205) 

The image information (image information of the superstructure map) 
encoded upon employment of the TA-DCT is transmitted via a transmission medium 
107 to the second computer 108 together with data of the volume model of the object 
as well as of the allocation (n^, n^, nj^ {i = l ... N, with N = number of triangles of the 
grid structure of the volume model). 

6. Decoding (206) 

An image decoding is implemented after transmission of the encoded 
image information. 

To that end, the spectral coefficients Cj are supplied to an inverse TA- 
DCT. 
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Given inverse TA-DCT in the framework if image encoding in the intra- 
image encoding mode, picture elements Xj are formed from the spectral coefficients Cj 
according to the following rule (4): 



whereby the transformation matrix DCT-N comprises the following structure: 



with p,k = 0 - N-1. 
whereby 

- N references a size of the image vector to be transformed wherein the picture 
elements to be transformed are contained; 

- [ DCT-N (p, k)] references a transformation matrix having the size NxN; 
p, k reference indices with p, k e [0, N-1]; 

- ( references an inversion of a matrix. 

The decoded image or, respectively, the superstructure map 602 is 
determined upon employment of the determined picture elements Xj. 

7. Presentation of the Object (207) 

The model of the object 152 is presented on the picture screen 108 upon 
employment of the superstructure map, the data of the volume model of the object 
1 52 as well as the allocation(ns, n^, nj^ (i = 1 N, with N = number of triangles of 
the grid structure of the volume model), as described in [6]. 
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Patent Claims 

1 . Method for processing a digitalized image with picture elements that 
contain an encoding information, 

a) whereby the image is at least partially divided into image blocks; 

5 b) whereby an appertaining image block is respectively subdivided into at 

least two appertaining image sub-blocks; 
characterized in that the processing of the image is implemented such that a first 
value, a second value and a third value are respectively allocated to at least one image 
sub-block, whereby the first value and the second value describe the relative position 
10 of the appertaining image block with respect to the image and the third value 

describes the relative position of the appertaining image sub-block with respect to the 
appertaining image block. 

2, Method according to claim 1, whereby the appertaining image block is 
subdivided into a plurality of appertaining image sub-blocks. 

15 3. Method according to claim 1 or 2, whereby the first value, the second 

value and the third value are respectively allocated to each appertaining image sub- 
block. 

4. Method according to one of the claims 1 through 3, whereby the image 
blocks are arranged in columns and rows and/or column numbers are assigned to the 

2 0 columns and row numbers are assigned to the rows. 

5. Method according to claim 4, whereby the first value of the 
appertaining image sub-block is the row number of the appertaining image block and 
the second value of the appertaining image sub-block is the column number of the 
appertaining image block. 

2 5 6. Method according to one of the claims 1 through 5, whereby the 

appertaining image sub-blocks exhibit a different shape than the appertaining image 
block, 

7. Method according to one of the claims 1 through 6, whereby the image 
sub-blocks comprise a triangular shape. 

3 0 8. Method according to claim 7, whereby the triangular shape comprises a 

right angle. 
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9. Method according to one of the claims 1 through 8, whereby the 
appertaining image sub-blocks are modified such that the respective position of an 
appertaining image sub-block with respect to the appertaining image block is 
respectively identical. 

10. Method according to one of the claims 1 through 9 utilized in the 
framework of an encoding of the image. 

11. Method according to claim 10, whereby the image sub-blocks are 
encoded upon employment of the encoding information and/or upon employment of 
the first value, the second value and the third value with a shape- adaptive 
transformation encoding. 

12. Method according to claim 11, whereby a shape-adaptive Discrete 
Cosine Transformation (DCT) is utilized for the encoding. 

13. Method according to claim 12, whereby a Shape- Adaptive Discrete 
Cosine Transformation (SA-DCT) is utihzed for the encoding. 

14. Method according to claim 13, whereby a Triangle- Adaptive Discrete 
Cosine Transformation (TA-DCT) is utilized for the encoding. 

15. Method according to one of the claims 1 through 9 utilized in the 
framework of a decoding of the image. 

16. Method according to claim 15, whereby an inverse shape-adaptive 
Discrete Cosine Transformation (DCT) is utiUzed for the decoding. 

17. Method according to claim 16, whereby an inverse Shape-Adaptive 
Discrete Cosine Transformation (SA-DCT) is utilized for the decoding. 

18. Method according to claim 17, whereby an inverse Triangle-Adaptive 
Discrete Cosine Transformation (TA-DCT) is utilized for the decoding. 

19. Method according to one of the claims 1 through 18, whereby the 
image at least partly comprises triangular structure maps, 

20. Arrangement for processing a digitalized image with picture elements 
that contain an encoding information, whereby a processor is provided that is 
configured such that the following method steps can be implemented: 

a) the image is at least partially divided into image blocks; 
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b) an appertaining image block is respectively subdivided into at least two 

appertaining image sub-blocks; 
characterized in that the processing of the image is implemented such that a first 
value, a second value and a third value are respectively allocated to at least one image 
5 sub-block, whereby the first value and the second value describe the relative position 
of the appertaining image block with respect to the image and the third value 
describes the relative position of the appertaining image sub-block with respect to the 
appertaining image block. 

21. Arrangement according to claim 20, whereby the appertaining image 
1 0 block can be subdivided into a plurality of appertaining image sub-blocks. 

22. Arrangement according to claim 20 or 21, whereby the respective first 
value and the respective second value and the respective third value can be allocated 
to each appertaining image sub-block. 

23. Arrangement according to one of the claims 20 through 22 that can be 
1 5 utilized in the framework of an encoding of the image. 

24. Arrangement according to claim 23, whereby a shape- adaptive 
Discrete Cosine Transformation (DCT) can be utilized for the encoding. 

25. Arrangement according to claim 24, whereby an inverse Triangle- 
Adaptive Discrete Cosine Transformation (TA-DCT) can be utilized for the encoding. 

2 0 26, Arrangement according to one of the claims 20 through 25 that can be 

utilized in the firamework of a decoding of the image. 

27. Arrangement according to claim 26, whereby an inverse shape- 
adaptive Discrete Cosine Transformation (DCT) can be utilized for the decoding. 

28. Arrangement according to claim 27, whereby an inverse Triangle- 

2 5 Adaptive Discrete Cosine Transformation (TA-DCT) can be utilized for the decoding. 
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Abstract 

METHOD AND ARRANGEMENT FOR PROCESSING A DIGITALIZED IMAGE 

Methods and arrangements are recited for processing a digitalized image 
with picture elements that contain an encoding information. To that end, the image is 
5 divided into image blocks and a respective image block is divided into two image 
sub-blocks. The processing of the image is implemented such that a respective first 
value and a respective second value and a respective third value is allocated to an 
image sub-block, whereby the first value and the second value describe the relative 
position of the appertaining image block with respect to the image and the third value 
10 describes the relative position of the appertaining image sub-block with respect to the 
appertaining image block. Further, the employment of the method and of the 
arrangement in the framework of an encoding and decoding is recited. 
Figure 2 
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Datum 


Second Inventor's signature 


Date 


Wohnsitz 


Residence 


staatsa n g eii5rigkelt 


Citizenship 


Postanschrift 


Post Office Address 







{Bitte entsprechende informationen und Unterschriften im 
Falfe von dritten und weiteren Miterfindern angeben). 



(Supply similar information and signature for third and 
subsequent Joint inventors). 
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Form PTO-FB-240 (8-83) 



Patent and Trademark Office-U.S. Department of COMMERCE 



GR 98 P 2946 P US 



Declaration and Power of Attorney For Patent Application 
Erklarung Fur Patentanmeldungen Mit Vollmacht 

German Language Declaration 



Als nachstehend benannter Erfinder erklare ich hiermit As a below named inventor, 1 hereby declare that; 

an Eides Statt: 



dass mein Wohnsitz. meine Postanschrift, und nneine My residence, post office address and citizenship are 

Staatsangehorigkeit den im Nachstehenden nach as stated below next to nny name, 

melnem Namen aufgefuhrten Angaben entsprechen, 



dass ich, nach bestem Wissen der ursprungilche, 
erste und allelnlge Erfinder (falls nachstehend nur ein 
Name angegeben ist) oder ein ursprungllcher, erster 
und Mlterfinder (falls nachstehend mehrere Namen 
aufgefOhrt sind) des Gegenstandes bin, fur den dieser 
Antrag gestellt wird und fur den ein Patent beantragt 
wird fur die Erfindung mit dem Titei: 

Verfahren und Anordnuna zur Bearbeitung 
eines diqitalisierten Bildes 



I believe 1 am the original, first and sole inventor (if 
only one name is listed below) or an original, first and 
joint inventor (if plural names are listed below) of the 
subject matter which is claimed and for which a patent 
is sought on the invention entitled 



deren Beschreibung 

(zutreffendjhaes ankreuzen) 

O hier beigefugt ist. 

n am als 

PCT internationaie Anmeldung 

PCT Anmeldungsnummer 

Eingereicht wurde und am 

Abgeandert wurde (falls tatsachlich abgeandert). 



the specification of which 

(check one) 

CH is attached hereto. 

□ was filed on as 

PCT international application 

PCT Application No. 

and was amended on 

(if applicable) 



Ich bestatige hiermit, dass ich den Inhalt der obigen 
Patentanmeldung einschftesslich der Anspruche 
durchgesehen und verstanden habe, die eventueil 
durch einen Zusatzantrag wie oben erwahnt abgean- 
dert wurde. 



I hereby state that I have reviewed and understand the 
contents of the above identified specification, inclu- 
ding the claims as amended by any amendment refer- 
red to above. 



Ich erkenne meine Pflicht zur Offenbarung irgendwel- 
cher Informationen, die fur die Prufung der vorliegen- 
den Anmeldung in Einklang mit Absatz 37, Bundes- 
gesetzbuch, Paragraph 156(a) von Wichtigkeit sind, 
an. 



I acknowledge the duty to disclose information which 
is material to the examination of this application in 
accordance with Title 37, Code of Federal Regula- 
tions, §1. 56(a). 



Ich beanspruche hiermit auslandische Phoritatsvor- 
teile gemass Abschnitt 35 der Zivilprozessordnung der 
Vereinigten Staaten, Paragraph 119 aller unten ange- 
gebenen Auslandsanmeldungen fQr ein Patent oder 
eine Erfindersurkunde, und habe auch alle Auslands- 
anmeldungen fiir ein Patent oder eine Erfindersurkun- 
de nachstehend gekennzeichnet, die ein Anmeide- 
datum haben, das vor dem Anmeldedatum der An- 
meldung liegt, fur die Prioritat beansprucht wird. 



I hereby claim foreign priority benefits under Title 35, 
United States Code, §119 of any foreign application(s) 
for patent or inventor's certificate listed below and 
have also identified below any foreign application for 
patent or inventor's certificate having a filing date 
before that of the application on which priority is clai- 
med: 
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Patent and Trademark OfRce-U.S. DEPARTMENT OF COMMERCE 



German Language Declaration 


Prior foreign apppfications 
Prioritat beansprucht 


Priority Claimed 


1 98 48 987.0 Germany 23. Oktober 1 998 [HI □ 


(Number) (Country) (Day Month Year Filed) Yes No 
(Nummer) (Land) (Tag Monat Jahr eingereicht) Ja Nein 




□ □ 


(Number) (Country) (Day Month Year Filed) Yes No 
(Nummer) (Land) (Tag Monat Jahr eingereicht) Ja Nein 




□ □ 


(Number) (Country) (Day Month Year Filed) Yes No 
(Nummer) (Land) (Tag Monat Jahr eingereicht) Ja Nein 


Ich beanspruche hiermit gemass Absatz 35 der Zlvil- 
prozessordnung der Vereinigten Staaten, Paragraph 
120, den Vorzug afler unten aufgefuhrten Anmel- 
dungen und falls der Gegenstand aus jedem An- 
spruch dieser Anmeldung ntcht in einer fruheren ame- 
rikanischen Patentanmeidung laut dem ersten Para- 
graphen des Absatzes 35 der ZivilprozeSordnung der 
Vereinigten Staaten, Paragraph 122 offenbart ist, 
erkenne ich gemass Absatz 37, Bundesgesetzbuch, 
Paragraph 1.56(a) meine Pflicht zur Offenbarung von 
informationen an, die zwischen dem Anmeidedatum 
der frOheren Anmeidung und dem nationalen oder 
PCT internatlonalen Anmeidedatum dieser Anmel- 
dung bekannt geworden sind. 


1 hereby claim the benefit under Title 35. United Sta- 
tes Code. §120 of any United States application(s) 
listed below and, insofar as the subject matter of each 
of the claims of this application is not disclosed in the 
prior United States application in the manner provided 
by the first paragraph of Title 35, United States Code, 
§122, 1 acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal 
Regulations, §1. 56(a) which occured between the 
filing date of the prior application and the national or 
PCT international filing date of this application. 


(Application Serial Mo.) (Filing Date) 
(Anmeldeseriennummer) (Anmeidedatum) 


(Status) (Status) 
(patentiert, anhangig, (patented, pending, 
aufgegeben) abandoned) 


(Application Serial No.) (Filing Date) 
(Anmeldeseriennummer) (Anmeidedatum) 


(Status) (Status) 
(patentiert, anhangig, (patented, pending, 
aufgeben) abandoned) 


Ich erkiare hiermit, dass alle von mir in der vorliegen- 
den Erklarung gemachten Angaben nach metnem 
besten Wissen und Gewissen der vollen Wahrheit 
entsprechen, und dass ich diese eidesstattliche Erkla- 
rung in Kenntnis dessen abgebe, dass wissentlich und 
vorsatzlich falsche Angaben gemass Paragraph 1001, 
Absatz 18 der Zivilprozessordnung der Vereinigten 
Staaten von Amerika mit Geldstrafe belegt und/oder 
Gefangnis bestraft werden koennen, und dass derartig 
wissentlich und vorsatzlich faische Angaben die Gul- 
tlgkeit der vorliegenden Patentanmeidung oder eines 
darauf erteilten Patentes gefahrden konnen. 


1 hereby declare that all statements made herein of 
my own knowledge are true and that all statements 
made on information and belief are believed to be 
true, and further that these statements were made 
with the knowledge that willful false statements and 
the like so made are punishable by fine or imprison- 
ment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false state- 
ments may jeopardize the validity of the application or 
any patent issued thereon. 
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